Max level shown:
1 [ May 22 21:17:24 Enabled. ]
2 [ May 22 21:17:24 Rereading configuration. ]
3 [ May 22 21:17:26 Rereading configuration. ]
4 [ May 22 21:17:33 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ May 22 21:17:33 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-05-22T21:17:33.588ZDEBGnexus: registered DTrace probes
82025-05-22T21:17:33.590ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:78
92025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = TargetReleaseConfig file = nexus/auth/src/authz/oso_generic.rs:68
242025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = WebhookEventClassList file = nexus/auth/src/authz/oso_generic.rs:68
252025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
262025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
272025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
282025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
292025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = AffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
302025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = AntiAffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
312025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
322025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
332025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
342025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
352025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
362025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
372025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
382025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
392025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
402025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
412025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
422025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
432025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
442025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
452025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
462025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
472025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
482025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
492025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
502025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
512025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
522025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
532025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
542025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
552025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
562025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
572025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
582025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SupportBundle file = nexus/auth/src/authz/oso_generic.rs:68
592025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
602025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
612025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
622025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
632025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
642025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = WebhookEvent file = nexus/auth/src/authz/oso_generic.rs:68
652025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = WebhookReceiver file = nexus/auth/src/authz/oso_generic.rs:68
662025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = WebhookSecret file = nexus/auth/src/authz/oso_generic.rs:68
672025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
682025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
692025-05-22T21:17:33.599ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
702025-05-22T21:17:33.599ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\nresource WebhookSecret {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_webhook_receiver: WebhookReceiver };\n\n\t"read" if "read" on "parent_webhook_receiver";\n\t"modify" if "modify" on "parent_webhook_receiver";\n}\n\nhas_relation(rx: WebhookReceiver, "parent_webhook_receiver", secret: WebhookSecret)\n\tif secret.webhook_receiver = rx;\n\nresource WebhookEventClassList {\n\tpermissions = [ "list_children" ];\n\trelations = { parent_fleet: Fleet };\n\n\t"list_children" if "viewer" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", collection: WebhookEventClassList)\n\tif collection.fleet = fleet;\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource WebhookEvent {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: WebhookEvent)\n if child.fleet = fleet;\n \n\n resource WebhookReceiver {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: WebhookReceiver)\n if child.fleet = fleet;\n \n\n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
712025-05-22T21:17:33.622ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:222
722025-05-22T21:17:33.625ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
732025-05-22T21:17:33.631ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:278
742025-05-22T21:17:33.637ZDEBGnexus (ServerContext): registered USDT probes
752025-05-22T21:17:33.684ZINFOnexus: Database schema version is up to date desired_version = 142.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:143 found_version = 142.0.0
762025-05-22T21:17:33.686ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:813 sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
772025-05-22T21:17:33.747ZDEBGnexus (clickhouse-client): registered USDT probes id = 92994c07-75b7-4456-bdd4-92eae88d06e5
782025-05-22T21:17:33.776ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
792025-05-22T21:17:33.803ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
802025-05-22T21:17:33.803ZDEBGnexus (DataLoader): attempting to create built-in users
812025-05-22T21:17:33.803ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
822025-05-22T21:17:33.803ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
832025-05-22T21:17:33.815ZINFOnexus (MgsUpdateDriver): starting MgsUpdateDriver file = nexus/mgs-updates/src/driver.rs:148
842025-05-22T21:17:33.854ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:393
852025-05-22T21:17:33.854ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862025-05-22T21:17:33.857ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872025-05-22T21:17:33.857ZDEBGnexus (DataLoader): attempting to create built-in roles
882025-05-22T21:17:33.857ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892025-05-22T21:17:33.858ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
912025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
922025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
942025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
952025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
1012025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
1032025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
1062025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
1082025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
1092025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1122025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /experimental/v1/system/support-bundles versions = all
1132025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /experimental/v1/system/support-bundles versions = all
1142025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1152025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
1162025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1172025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
1182025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1192025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
1202025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
1212025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1222025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1232025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1242025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1252025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /mgs-updates versions = all
1262025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1272025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /oximeter/read-policy versions = all
1282025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /oximeter/read-policy versions = all
1292025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1302025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1312025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1322025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1332025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1342025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1352025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1362025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1372025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1382025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1392025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1402025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1412025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /v1/ping versions = all
1422025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1432025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1442025-05-22T21:17:33.877ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:12221
1452025-05-22T21:17:33.877ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1462025-05-22T21:17:33.877ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1472025-05-22T21:17:33.878ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1482025-05-22T21:17:33.880ZWARNnexus: Cannot look up rack: Object (of type ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744)) not found: rack file = nexus/src/app/rack.rs:778
1492025-05-22T21:17:33.911ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1502025-05-22T21:17:33.911ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512025-05-22T21:17:33.912ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522025-05-22T21:17:33.912ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1532025-05-22T21:17:33.912ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542025-05-22T21:17:33.912ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552025-05-22T21:17:33.979ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1562025-05-22T21:17:33.979ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572025-05-22T21:17:33.980ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582025-05-22T21:17:33.980ZDEBGnexus (DataLoader): attempting to create built-in silos
1592025-05-22T21:17:33.980ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602025-05-22T21:17:33.980ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1612025-05-22T21:17:34.076ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1622025-05-22T21:17:34.077ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1632025-05-22T21:17:34.077ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1642025-05-22T21:17:34.098ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1652025-05-22T21:17:34.099ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1662025-05-22T21:17:34.099ZDEBGnexus (DataLoader): attempting to create built-in projects
1672025-05-22T21:17:34.099ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682025-05-22T21:17:34.099ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692025-05-22T21:17:34.105ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702025-05-22T21:17:34.106ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712025-05-22T21:17:34.154ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722025-05-22T21:17:34.155ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732025-05-22T21:17:34.190ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742025-05-22T21:17:34.192ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752025-05-22T21:17:34.193ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762025-05-22T21:17:34.193ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772025-05-22T21:17:34.231ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782025-05-22T21:17:34.231ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792025-05-22T21:17:34.233ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802025-05-22T21:17:34.235ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1812025-05-22T21:17:34.235ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822025-05-22T21:17:34.235ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832025-05-22T21:17:34.332ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1842025-05-22T21:17:34.332ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1852025-05-22T21:17:34.333ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1862025-05-22T21:17:34.333ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1872025-05-22T21:17:34.333ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882025-05-22T21:17:34.333ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892025-05-22T21:17:34.339ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902025-05-22T21:17:34.339ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912025-05-22T21:17:34.341ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922025-05-22T21:17:34.342ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1932025-05-22T21:17:34.343ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942025-05-22T21:17:34.343ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952025-05-22T21:17:34.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962025-05-22T21:17:34.345ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972025-05-22T21:17:34.381ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982025-05-22T21:17:34.383ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1992025-05-22T21:17:34.383ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002025-05-22T21:17:34.384ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012025-05-22T21:17:34.442ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022025-05-22T21:17:34.442ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032025-05-22T21:17:34.444ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042025-05-22T21:17:34.445ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052025-05-22T21:17:34.456ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062025-05-22T21:17:34.458ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2072025-05-22T21:17:34.458ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082025-05-22T21:17:34.458ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092025-05-22T21:17:34.511ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102025-05-22T21:17:34.512ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112025-05-22T21:17:34.513ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122025-05-22T21:17:34.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132025-05-22T21:17:34.515ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142025-05-22T21:17:34.515ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152025-05-22T21:17:34.517ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162025-05-22T21:17:34.520ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2172025-05-22T21:17:34.520ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182025-05-22T21:17:34.520ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192025-05-22T21:17:34.554ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202025-05-22T21:17:34.554ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212025-05-22T21:17:34.556ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222025-05-22T21:17:34.556ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232025-05-22T21:17:34.562ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242025-05-22T21:17:34.563ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252025-05-22T21:17:34.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262025-05-22T21:17:34.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272025-05-22T21:17:34.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282025-05-22T21:17:34.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292025-05-22T21:17:34.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302025-05-22T21:17:34.571ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312025-05-22T21:17:34.572ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322025-05-22T21:17:34.572ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332025-05-22T21:17:34.574ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342025-05-22T21:17:34.577ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2352025-05-22T21:17:34.577ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362025-05-22T21:17:34.577ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2372025-05-22T21:17:34.579ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382025-05-22T21:17:34.579ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392025-05-22T21:17:34.580ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402025-05-22T21:17:34.580ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412025-05-22T21:17:34.581ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422025-05-22T21:17:34.585ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2432025-05-22T21:17:34.585ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442025-05-22T21:17:34.585ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452025-05-22T21:17:34.624ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462025-05-22T21:17:34.624ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2472025-05-22T21:17:34.625ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482025-05-22T21:17:34.626ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492025-05-22T21:17:34.627ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502025-05-22T21:17:34.627ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512025-05-22T21:17:34.628ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522025-05-22T21:17:34.632ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2532025-05-22T21:17:34.632ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542025-05-22T21:17:34.632ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552025-05-22T21:17:34.790ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2562025-05-22T21:17:34.790ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572025-05-22T21:17:34.790ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582025-05-22T21:17:34.793ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592025-05-22T21:17:34.793ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602025-05-22T21:17:34.795ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612025-05-22T21:17:34.796ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622025-05-22T21:17:34.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632025-05-22T21:17:34.798ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642025-05-22T21:17:34.800ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652025-05-22T21:17:34.800ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662025-05-22T21:17:34.815ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672025-05-22T21:17:34.815ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682025-05-22T21:17:34.817ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692025-05-22T21:17:34.819ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2702025-05-22T21:17:34.819ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712025-05-22T21:17:34.820ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2722025-05-22T21:17:34.821ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732025-05-22T21:17:34.821ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742025-05-22T21:17:34.822ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752025-05-22T21:17:34.822ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762025-05-22T21:17:34.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772025-05-22T21:17:34.827ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2782025-05-22T21:17:34.827ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792025-05-22T21:17:34.827ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802025-05-22T21:17:34.851ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812025-05-22T21:17:34.852ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822025-05-22T21:17:34.853ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832025-05-22T21:17:34.853ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842025-05-22T21:17:34.855ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852025-05-22T21:17:34.855ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862025-05-22T21:17:34.856ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872025-05-22T21:17:34.859ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2882025-05-22T21:17:34.859ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892025-05-22T21:17:34.859ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902025-05-22T21:17:34.945ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:285
2912025-05-22T21:17:34.945ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2922025-05-22T21:17:34.945ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932025-05-22T21:17:34.945ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942025-05-22T21:17:34.959ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952025-05-22T21:17:34.959ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962025-05-22T21:17:34.961ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972025-05-22T21:17:34.962ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982025-05-22T21:17:34.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992025-05-22T21:17:34.964ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3002025-05-22T21:17:34.965ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012025-05-22T21:17:34.965ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022025-05-22T21:17:34.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032025-05-22T21:17:34.967ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042025-05-22T21:17:34.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052025-05-22T21:17:34.971ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3062025-05-22T21:17:34.971ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072025-05-22T21:17:34.971ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082025-05-22T21:17:34.986ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092025-05-22T21:17:34.986ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102025-05-22T21:17:34.988ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112025-05-22T21:17:34.988ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122025-05-22T21:17:34.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132025-05-22T21:17:34.989ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142025-05-22T21:17:34.991ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152025-05-22T21:17:34.991ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162025-05-22T21:17:34.992ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172025-05-22T21:17:34.992ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182025-05-22T21:17:34.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192025-05-22T21:17:34.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202025-05-22T21:17:34.995ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212025-05-22T21:17:34.999ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3222025-05-22T21:17:34.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232025-05-22T21:17:34.999ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242025-05-22T21:17:35.001ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252025-05-22T21:17:35.001ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262025-05-22T21:17:35.003ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272025-05-22T21:17:35.003ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282025-05-22T21:17:35.004ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292025-05-22T21:17:35.004ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302025-05-22T21:17:35.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312025-05-22T21:17:35.006ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322025-05-22T21:17:35.007ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332025-05-22T21:17:35.008ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342025-05-22T21:17:35.009ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352025-05-22T21:17:35.009ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362025-05-22T21:17:35.010ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372025-05-22T21:17:35.016ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3382025-05-22T21:17:35.016ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392025-05-22T21:17:35.016ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402025-05-22T21:17:35.017ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412025-05-22T21:17:35.018ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422025-05-22T21:17:35.019ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432025-05-22T21:17:35.020ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442025-05-22T21:17:35.021ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452025-05-22T21:17:35.021ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462025-05-22T21:17:35.022ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472025-05-22T21:17:35.023ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482025-05-22T21:17:35.024ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492025-05-22T21:17:35.024ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502025-05-22T21:17:35.025ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512025-05-22T21:17:35.026ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522025-05-22T21:17:35.027ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532025-05-22T21:17:35.031ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3542025-05-22T21:17:35.031ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552025-05-22T21:17:35.031ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562025-05-22T21:17:35.051ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:351
3572025-05-22T21:17:35.051ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:227
3582025-05-22T21:17:35.051ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592025-05-22T21:17:35.052ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602025-05-22T21:17:35.052ZDEBGnexus (DataLoader): attempting to create silo users
3612025-05-22T21:17:35.052ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622025-05-22T21:17:35.052ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632025-05-22T21:17:35.060ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:418
3642025-05-22T21:17:35.060ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3652025-05-22T21:17:35.060ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662025-05-22T21:17:35.061ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672025-05-22T21:17:35.062ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:445
3682025-05-22T21:17:35.063ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692025-05-22T21:17:35.063ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702025-05-22T21:17:35.064ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712025-05-22T21:17:35.065ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722025-05-22T21:17:35.069ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732025-05-22T21:17:35.070ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742025-05-22T21:17:35.075ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752025-05-22T21:17:35.076ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3762025-05-22T21:17:35.076ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772025-05-22T21:17:35.076ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782025-05-22T21:17:35.080ZINFOnexus: populate complete file = nexus/src/app/mod.rs:522
3792025-05-22T21:17:35.080ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:531
3802025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
3812025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
3822025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
3832025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
3842025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3852025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3862025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3872025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3882025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
3892025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3902025-05-22T21:17:35.084ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3912025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
3922025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
3932025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 1 reason = Timeout
3942025-05-22T21:17:35.084ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3952025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3962025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3972025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
3982025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
3992025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4002025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4012025-05-22T21:17:35.084ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:76 reason = no blueprint
4022025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4032025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4042025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4052025-05-22T21:17:35.084ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4062025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4072025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
4082025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4092025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4102025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4112025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4122025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4132025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4142025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4152025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4162025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4172025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4182025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4192025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4202025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4212025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4222025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4232025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4242025-05-22T21:17:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4252025-05-22T21:17:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4262025-05-22T21:17:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 1 reason = Timeout
4272025-05-22T21:17:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4282025-05-22T21:17:35.086ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
4292025-05-22T21:17:35.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
4302025-05-22T21:17:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
4312025-05-22T21:17:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 2.218393ms iteration = 1 status = {"error":"no blueprint"}
4322025-05-22T21:17:35.086ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
4332025-05-22T21:17:35.088ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4342025-05-22T21:17:35.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4352025-05-22T21:17:35.103ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4362025-05-22T21:17:35.103ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4372025-05-22T21:17:35.103ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4382025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4392025-05-22T21:17:35.103ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4402025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4412025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4422025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4432025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4442025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4452025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
4462025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4472025-05-22T21:17:35.103ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4482025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4492025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4502025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4512025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4522025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4532025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 861.063\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4542025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 995.994\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4552025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 885.453\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4562025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.066426ms iteration = 1 status = {"error":"no config nor servers"}
4572025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4582025-05-22T21:17:35.103ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4592025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4602025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
4612025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4622025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4632025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4642025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4652025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4662025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4672025-05-22T21:17:35.104ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:07:35.084599548 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4682025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4692025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
4702025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4712025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4722025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4732025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
4742025-05-22T21:17:35.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4752025-05-22T21:17:35.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 249518955 } })
4762025-05-22T21:17:35.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 249519984 } })
4772025-05-22T21:17:35.106ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4782025-05-22T21:17:35.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4792025-05-22T21:17:35.108ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 23.669462ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4802025-05-22T21:17:35.108ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4812025-05-22T21:17:35.108ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4822025-05-22T21:17:35.108ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 7.64\u{b5}s iteration = 2 status = {"error":"no config"}
4832025-05-22T21:17:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4842025-05-22T21:17:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4852025-05-22T21:17:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4862025-05-22T21:17:35.111ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4872025-05-22T21:17:35.114ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4882025-05-22T21:17:35.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 29.5603ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
4892025-05-22T21:17:35.114ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4902025-05-22T21:17:35.114ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4912025-05-22T21:17:35.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 5.61\u{b5}s iteration = 2 status = {"error":"no config"}
4922025-05-22T21:17:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4932025-05-22T21:17:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4942025-05-22T21:17:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4952025-05-22T21:17:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4962025-05-22T21:17:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4972025-05-22T21:17:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
4982025-05-22T21:17:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4992025-05-22T21:17:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5002025-05-22T21:17:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5012025-05-22T21:17:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5022025-05-22T21:17:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5032025-05-22T21:17:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5042025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5052025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5062025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5072025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5082025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5092025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5102025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
5112025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5122025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5132025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5142025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5152025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5162025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5172025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5182025-05-22T21:17:35.122ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5192025-05-22T21:17:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5202025-05-22T21:17:35.169ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 313313654 } })
5212025-05-22T21:17:35.169ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
5222025-05-22T21:17:35.173ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:07:35.084599548 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5232025-05-22T21:17:35.173ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 89.158626ms iteration = 1 status = {"expiration":"2025-05-22T21:07:35.084599548Z","pruned":[]}
5242025-05-22T21:17:35.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5252025-05-22T21:17:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5262025-05-22T21:17:35.178ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5272025-05-22T21:17:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5282025-05-22T21:17:35.182ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5292025-05-22T21:17:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5302025-05-22T21:17:35.186ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
5312025-05-22T21:17:35.186ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 100.925922ms iteration = 1 status = {"by_rx":{},"error":null}
5322025-05-22T21:17:35.187ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 331926431 } })
5332025-05-22T21:17:35.188ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 103.944446ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5342025-05-22T21:17:35.188ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
5352025-05-22T21:17:35.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5362025-05-22T21:17:35.193ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 108.624376ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5372025-05-22T21:17:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5382025-05-22T21:17:35.222ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5392025-05-22T21:17:35.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
5402025-05-22T21:17:35.223ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5412025-05-22T21:17:35.226ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5422025-05-22T21:17:35.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5432025-05-22T21:17:35.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5442025-05-22T21:17:35.227ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5452025-05-22T21:17:35.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5462025-05-22T21:17:35.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5472025-05-22T21:17:35.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5482025-05-22T21:17:35.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5492025-05-22T21:17:35.229ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de3f02cd-4bbf-4867-885a-484da05e8f09", "content-length": "26", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
5502025-05-22T21:17:35.230ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512025-05-22T21:17:35.230ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5522025-05-22T21:17:35.230ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5532025-05-22T21:17:35.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542025-05-22T21:17:35.234ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5552025-05-22T21:17:35.234ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 149.90867ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5562025-05-22T21:17:35.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5572025-05-22T21:17:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5582025-05-22T21:17:35.237ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5592025-05-22T21:17:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5602025-05-22T21:17:35.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5612025-05-22T21:17:35.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5622025-05-22T21:17:35.238ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5632025-05-22T21:17:35.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5642025-05-22T21:17:35.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5652025-05-22T21:17:35.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5662025-05-22T21:17:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5672025-05-22T21:17:35.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5682025-05-22T21:17:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5692025-05-22T21:17:35.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5702025-05-22T21:17:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5712025-05-22T21:17:35.240ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5722025-05-22T21:17:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5732025-05-22T21:17:35.247ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5742025-05-22T21:17:35.248ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5752025-05-22T21:17:35.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5762025-05-22T21:17:35.250ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5772025-05-22T21:17:35.250ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5782025-05-22T21:17:35.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5792025-05-22T21:17:35.253ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 168.643029ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
5802025-05-22T21:17:35.254ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
5812025-05-22T21:17:35.254ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5822025-05-22T21:17:35.255ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "965c97eb-adbd-42c1-9a88-0e584e2426dc", "content-length": "26", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
5832025-05-22T21:17:35.255ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5842025-05-22T21:17:35.256ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5852025-05-22T21:17:35.257ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5862025-05-22T21:17:35.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5872025-05-22T21:17:35.260ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
5882025-05-22T21:17:35.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
5892025-05-22T21:17:35.261ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5902025-05-22T21:17:35.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5912025-05-22T21:17:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5922025-05-22T21:17:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5932025-05-22T21:17:35.262ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5942025-05-22T21:17:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5952025-05-22T21:17:35.269ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5962025-05-22T21:17:35.271ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5972025-05-22T21:17:35.271ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5982025-05-22T21:17:35.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5992025-05-22T21:17:35.272ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6002025-05-22T21:17:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6012025-05-22T21:17:35.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022025-05-22T21:17:35.280ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6032025-05-22T21:17:35.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6042025-05-22T21:17:35.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6052025-05-22T21:17:35.286ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 202.350061ms iteration = 1 status = {}
6062025-05-22T21:17:35.299ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:94
6072025-05-22T21:17:35.300ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 215.439966ms iteration = 1 status = {"error":"inventory collection is None"}
6082025-05-22T21:17:35.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6092025-05-22T21:17:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6102025-05-22T21:17:35.310ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 225.8593ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6112025-05-22T21:17:35.313ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6122025-05-22T21:17:35.313ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 229.260201ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6132025-05-22T21:17:35.316ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6142025-05-22T21:17:35.316ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6152025-05-22T21:17:35.316ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
6162025-05-22T21:17:35.316ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6172025-05-22T21:17:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6182025-05-22T21:17:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6192025-05-22T21:17:35.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202025-05-22T21:17:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6212025-05-22T21:17:35.319ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:81 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
6222025-05-22T21:17:35.319ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 235.343282ms iteration = 1 status = {"error":"rack not yet initialized: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744"}
6232025-05-22T21:17:35.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242025-05-22T21:17:35.324ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6252025-05-22T21:17:35.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6262025-05-22T21:17:35.325ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6272025-05-22T21:17:35.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 241.026006ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6282025-05-22T21:17:35.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6292025-05-22T21:17:35.326ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6302025-05-22T21:17:35.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6312025-05-22T21:17:35.326ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 241.857958ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
6322025-05-22T21:17:35.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6332025-05-22T21:17:35.330ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 246.619939ms iteration = 1 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
6342025-05-22T21:17:35.333ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6352025-05-22T21:17:35.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6362025-05-22T21:17:35.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6372025-05-22T21:17:35.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6382025-05-22T21:17:35.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6392025-05-22T21:17:35.338ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402025-05-22T21:17:35.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6412025-05-22T21:17:35.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6422025-05-22T21:17:35.342ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6432025-05-22T21:17:35.343ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6442025-05-22T21:17:35.343ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6452025-05-22T21:17:35.343ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 258.801421ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6462025-05-22T21:17:35.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6472025-05-22T21:17:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6482025-05-22T21:17:35.346ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6492025-05-22T21:17:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6502025-05-22T21:17:35.351ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6512025-05-22T21:17:35.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6522025-05-22T21:17:35.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6532025-05-22T21:17:35.355ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6542025-05-22T21:17:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6552025-05-22T21:17:35.356ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6562025-05-22T21:17:35.356ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 964, tv_nsec: 500674841 } })
6572025-05-22T21:17:35.357ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6582025-05-22T21:17:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6592025-05-22T21:17:35.359ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
6602025-05-22T21:17:35.360ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6612025-05-22T21:17:35.360ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
6622025-05-22T21:17:35.360ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 275.881584ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6632025-05-22T21:17:35.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 276.88921ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6642025-05-22T21:17:35.361ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 277.265636ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6652025-05-22T21:17:35.361ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6662025-05-22T21:17:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6672025-05-22T21:17:35.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6682025-05-22T21:17:35.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6692025-05-22T21:17:35.364ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6702025-05-22T21:17:35.366ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 281.916924ms iteration = 1 status = null
6712025-05-22T21:17:35.366ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
6722025-05-22T21:17:35.366ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6732025-05-22T21:17:35.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6742025-05-22T21:17:35.368ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 283.848913ms iteration = 1 status = {}
6752025-05-22T21:17:35.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6762025-05-22T21:17:35.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6772025-05-22T21:17:35.375ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6782025-05-22T21:17:35.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6792025-05-22T21:17:35.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6802025-05-22T21:17:35.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6812025-05-22T21:17:35.379ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6822025-05-22T21:17:35.379ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 295.588198ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6832025-05-22T21:17:35.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6842025-05-22T21:17:35.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6852025-05-22T21:17:35.384ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6862025-05-22T21:17:35.384ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6872025-05-22T21:17:35.384ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6882025-05-22T21:17:35.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6892025-05-22T21:17:35.391ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6902025-05-22T21:17:35.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6912025-05-22T21:17:35.402ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6922025-05-22T21:17:35.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6932025-05-22T21:17:35.409ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6942025-05-22T21:17:35.409ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6952025-05-22T21:17:35.409ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6962025-05-22T21:17:35.410ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "f07fd6ee-2509-4760-995f-5637c4b0d9e1", "content-length": "476", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
6972025-05-22T21:17:35.415ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6982025-05-22T21:17:35.423ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "98f6cd86-7ec4-4af2-b524-3b98286d0677", "content-length": "734", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
6992025-05-22T21:17:35.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
7002025-05-22T21:17:35.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d104a83-7afc-4e71-a282-f38df910e98f", "content-length": "111", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7012025-05-22T21:17:35.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
7022025-05-22T21:17:35.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9ac72b7-cb35-4663-b439-0bc743056400", "content-length": "111", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7032025-05-22T21:17:35.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
7042025-05-22T21:17:35.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d4c80a8-3d2c-427f-989e-6ad5b9739cdc", "content-length": "170", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7052025-05-22T21:17:35.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
7062025-05-22T21:17:35.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e75a9a1-fcf5-439c-a6ab-348aac33f73d", "content-length": "170", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7072025-05-22T21:17:35.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
7082025-05-22T21:17:35.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1e3791c-63e0-4f2e-8726-0f3b9d911ca4", "content-length": "179", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7092025-05-22T21:17:35.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
7102025-05-22T21:17:35.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "00961708-4a28-49ba-822c-138f295cb3af", "content-length": "179", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7112025-05-22T21:17:35.430ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
7122025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 345.724165ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
7132025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
7142025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbb8befa-56ee-42c3-9020-4fe56ceafdea", "content-length": "702", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7152025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7162025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "789e0559-e297-4924-b670-4e5b3bee4b19", "content-length": "727", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7172025-05-22T21:17:35.430ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
7182025-05-22T21:17:35.430ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 346.281963ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
7192025-05-22T21:17:35.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7202025-05-22T21:17:35.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef1b2f0e-d027-4da7-b53a-a91aaf239aad", "content-length": "729", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7212025-05-22T21:17:35.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7222025-05-22T21:17:35.431ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d5f95f7-e0b3-47c7-bc47-8f5154068e18", "content-length": "728", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7232025-05-22T21:17:35.431ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7242025-05-22T21:17:35.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0479958b-6481-4b39-a774-d73e931c69f7", "content-length": "722", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7252025-05-22T21:17:35.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7262025-05-22T21:17:35.432ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a31c489-6095-432c-b3b4-35e81c89e71b", "content-length": "109", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7272025-05-22T21:17:35.432ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7282025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a83b0cbf-7d45-4332-af49-328d8676439b", "content-length": "109", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7292025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7302025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "07236b60-42e7-447e-8d8c-f472c9c6083d", "content-length": "169", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7312025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7322025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "882976f7-752a-42cd-ab96-3f341c08c378", "content-length": "169", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7332025-05-22T21:17:35.433ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7342025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff5fe0ec-e92c-45c6-aee4-00833a750a30", "content-length": "178", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7352025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7362025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "76b0c3ef-2f85-48cf-b5e3-91695fcdca4e", "content-length": "178", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7372025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7382025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a13fcf-4400-404d-8b60-0de33703b344", "content-length": "702", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7392025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7402025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e290f0f3-8136-4fec-9c61-08dd428c9650", "content-length": "727", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7412025-05-22T21:17:35.434ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7422025-05-22T21:17:35.435ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "469c5830-6345-4275-9e58-d9afc8970ee0", "content-length": "729", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7432025-05-22T21:17:35.435ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7442025-05-22T21:17:35.435ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "854578fc-40d1-4af0-bf06-91053f935a55", "content-length": "728", "date": "Thu, 22 May 2025 21:17:35 GMT"} })
7452025-05-22T21:17:35.435ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7462025-05-22T21:17:35.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7472025-05-22T21:17:35.436ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7482025-05-22T21:17:35.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7492025-05-22T21:17:35.438ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7502025-05-22T21:17:35.439ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7512025-05-22T21:17:35.440ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7522025-05-22T21:17:35.444ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
7532025-05-22T21:17:35.444ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 359.953886ms iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7542025-05-22T21:17:35.444ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7552025-05-22T21:17:35.444ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7562025-05-22T21:17:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7572025-05-22T21:17:35.446ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 361.991636ms iteration = 1 status = {}
7582025-05-22T21:17:35.446ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7592025-05-22T21:17:35.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7602025-05-22T21:17:35.448ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7612025-05-22T21:17:35.448ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 364.160678ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7622025-05-22T21:17:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7632025-05-22T21:17:35.451ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7642025-05-22T21:17:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7652025-05-22T21:17:35.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662025-05-22T21:17:35.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7672025-05-22T21:17:35.460ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682025-05-22T21:17:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692025-05-22T21:17:35.461ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7702025-05-22T21:17:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7712025-05-22T21:17:35.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722025-05-22T21:17:35.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732025-05-22T21:17:35.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 378.879568ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7742025-05-22T21:17:35.463ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7752025-05-22T21:17:35.463ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7762025-05-22T21:17:35.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7772025-05-22T21:17:35.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782025-05-22T21:17:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792025-05-22T21:17:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7802025-05-22T21:17:35.465ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7812025-05-22T21:17:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7822025-05-22T21:17:35.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7832025-05-22T21:17:35.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7842025-05-22T21:17:35.472ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7852025-05-22T21:17:35.472ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7862025-05-22T21:17:35.472ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 388.390279ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7872025-05-22T21:17:35.476ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7882025-05-22T21:17:35.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7892025-05-22T21:17:35.478ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7902025-05-22T21:17:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7912025-05-22T21:17:35.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7922025-05-22T21:17:35.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7932025-05-22T21:17:35.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7942025-05-22T21:17:35.484ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 399.87212ms iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[]}
7952025-05-22T21:17:35.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7962025-05-22T21:17:35.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7972025-05-22T21:17:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7982025-05-22T21:17:35.489ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7992025-05-22T21:17:35.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8002025-05-22T21:17:35.491ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8012025-05-22T21:17:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022025-05-22T21:17:35.493ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8032025-05-22T21:17:35.497ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8042025-05-22T21:17:35.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052025-05-22T21:17:35.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062025-05-22T21:17:35.525ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8072025-05-22T21:17:35.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8082025-05-22T21:17:35.529ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092025-05-22T21:17:35.529ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8102025-05-22T21:17:35.530ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8112025-05-22T21:17:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8122025-05-22T21:17:35.534ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8132025-05-22T21:17:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8142025-05-22T21:17:35.537ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
8152025-05-22T21:17:35.537ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
8162025-05-22T21:17:35.537ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
8172025-05-22T21:17:35.537ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8182025-05-22T21:17:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8192025-05-22T21:17:35.538ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8202025-05-22T21:17:35.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8212025-05-22T21:17:35.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8222025-05-22T21:17:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8232025-05-22T21:17:35.540ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8242025-05-22T21:17:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8252025-05-22T21:17:35.543ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8262025-05-22T21:17:35.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8272025-05-22T21:17:35.546ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8282025-05-22T21:17:35.546ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8292025-05-22T21:17:35.548ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8302025-05-22T21:17:35.553ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8312025-05-22T21:17:35.554ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8322025-05-22T21:17:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8332025-05-22T21:17:35.557ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8342025-05-22T21:17:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8352025-05-22T21:17:35.566ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8362025-05-22T21:17:35.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8372025-05-22T21:17:35.571ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8382025-05-22T21:17:35.577ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
8392025-05-22T21:17:35.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8402025-05-22T21:17:35.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8412025-05-22T21:17:35.578ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
8422025-05-22T21:17:35.578ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 493.583444ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
8432025-05-22T21:17:35.613ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8442025-05-22T21:17:35.614ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8452025-05-22T21:17:35.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8462025-05-22T21:17:35.616ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8472025-05-22T21:17:35.618ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8482025-05-22T21:17:35.619ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8492025-05-22T21:17:35.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8502025-05-22T21:17:35.635ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8512025-05-22T21:17:35.635ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8522025-05-22T21:17:35.635ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8532025-05-22T21:17:35.636ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8542025-05-22T21:17:35.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8552025-05-22T21:17:35.638ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8562025-05-22T21:17:35.641ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8572025-05-22T21:17:35.641ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8582025-05-22T21:17:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8592025-05-22T21:17:35.644ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8602025-05-22T21:17:35.649ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8612025-05-22T21:17:35.649ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8622025-05-22T21:17:35.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8632025-05-22T21:17:35.745ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 661.011516ms iteration = 1 status = {}
8642025-05-22T21:17:35.833ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8652025-05-22T21:17:35.833ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8662025-05-22T21:17:35.833ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
8672025-05-22T21:17:35.834ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 730.360909ms
8682025-05-22T21:17:35.834ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 749.359261ms iteration = 1 status = {}
8692025-05-22T21:17:35.882ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8702025-05-22T21:17:35.882ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8712025-05-22T21:17:35.884ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8722025-05-22T21:17:35.884ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8732025-05-22T21:17:35.886ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8742025-05-22T21:17:35.889ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
8752025-05-22T21:17:35.889ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
8762025-05-22T21:17:35.968ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c29d9385-2c49-41e7-b452-0bb7ca30dc03 file = nexus/db-queries/src/db/datastore/inventory.rs:1014
8772025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c29d9385-2c49-41e7-b452-0bb7ca30dc03 time_started = 2025-05-22 21:17:35.406126 UTC
8782025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8792025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8802025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 884.153467ms iteration = 1 status = {"collection_id":"c29d9385-2c49-41e7-b452-0bb7ca30dc03","time_done":"2025-05-22 21:17:35.537384 UTC","time_started":"2025-05-22 21:17:35.406126 UTC"}
8812025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
8822025-05-22T21:17:35.968ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
8832025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 5.14\u{b5}s iteration = 2 status = {"error":"no blueprint"}
8842025-05-22T21:17:35.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8852025-05-22T21:17:35.970ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8862025-05-22T21:17:35.972ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8872025-05-22T21:17:35.972ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8882025-05-22T21:17:35.972ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8892025-05-22T21:17:35.974ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:81 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
8902025-05-22T21:17:35.974ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 6.07187ms iteration = 2 status = {"error":"rack not yet initialized: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744"}
8912025-05-22T21:17:37.889ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8922025-05-22T21:17:37.890ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8932025-05-22T21:17:37.892ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8942025-05-22T21:17:37.892ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8952025-05-22T21:17:37.893ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962025-05-22T21:17:37.896ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
8972025-05-22T21:17:37.896ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
8982025-05-22T21:17:39.897ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8992025-05-22T21:17:39.898ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9002025-05-22T21:17:39.899ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9012025-05-22T21:17:39.899ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9022025-05-22T21:17:39.901ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9032025-05-22T21:17:39.904ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
9042025-05-22T21:17:39.904ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
9052025-05-22T21:17:41.796ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::2]:45425
9062025-05-22T21:17:41.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 8a849aea-e699-4841-a797-007955c9c1dc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9072025-05-22T21:17:41.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 8a849aea-e699-4841-a797-007955c9c1dc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9082025-05-22T21:17:41.816ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 19223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 8a849aea-e699-4841-a797-007955c9c1dc response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9092025-05-22T21:17:41.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 101c7270-b168-49ef-bec7-a84cf781f9d9 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9102025-05-22T21:17:41.820ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 101c7270-b168-49ef-bec7-a84cf781f9d9 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9112025-05-22T21:17:41.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 27001 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 101c7270-b168-49ef-bec7-a84cf781f9d9 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9122025-05-22T21:17:41.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 267d3bbc-de7a-4378-bfd4-31bb4191159e roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9132025-05-22T21:17:41.847ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 267d3bbc-de7a-4378-bfd4-31bb4191159e resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9142025-05-22T21:17:41.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 16458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 267d3bbc-de7a-4378-bfd4-31bb4191159e response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9152025-05-22T21:17:41.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 7a4972a9-d798-4b90-8152-bceeddfdc53a roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9162025-05-22T21:17:41.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 7a4972a9-d798-4b90-8152-bceeddfdc53a resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9172025-05-22T21:17:41.887ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 23675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 7a4972a9-d798-4b90-8152-bceeddfdc53a response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9182025-05-22T21:17:41.887ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2defdc0c-bd5c-4faf-ba96-e5948f7bf89f roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9192025-05-22T21:17:41.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2defdc0c-bd5c-4faf-ba96-e5948f7bf89f resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9202025-05-22T21:17:41.896ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 8900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2defdc0c-bd5c-4faf-ba96-e5948f7bf89f response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9212025-05-22T21:17:41.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2e43c195-369f-4756-9c1a-74e734c6ced6 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9222025-05-22T21:17:41.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2e43c195-369f-4756-9c1a-74e734c6ced6 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9232025-05-22T21:17:41.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 2e43c195-369f-4756-9c1a-74e734c6ced6 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9242025-05-22T21:17:41.899ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 72254afc-19e0-4a9f-ac32-df9bda2c42be roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9252025-05-22T21:17:41.899ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 72254afc-19e0-4a9f-ac32-df9bda2c42be resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9262025-05-22T21:17:41.902ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 72254afc-19e0-4a9f-ac32-df9bda2c42be response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9272025-05-22T21:17:41.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 1a83f66d-eda9-4f56-b69e-018d8f260d4b roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9282025-05-22T21:17:41.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 1a83f66d-eda9-4f56-b69e-018d8f260d4b resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9292025-05-22T21:17:41.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 1a83f66d-eda9-4f56-b69e-018d8f260d4b response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9302025-05-22T21:17:41.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 71b65fd9-0da2-41ed-9c67-542f25066632 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9312025-05-22T21:17:41.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 71b65fd9-0da2-41ed-9c67-542f25066632 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9322025-05-22T21:17:41.906ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9332025-05-22T21:17:41.906ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9342025-05-22T21:17:41.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 71b65fd9-0da2-41ed-9c67-542f25066632 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9352025-05-22T21:17:41.907ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9362025-05-22T21:17:41.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 67d3d137-6ca8-4b68-878a-dcdeb59f4712 roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
9372025-05-22T21:17:41.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 67d3d137-6ca8-4b68-878a-dcdeb59f4712 resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
9382025-05-22T21:17:41.908ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9392025-05-22T21:17:41.910ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9402025-05-22T21:17:41.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 67d3d137-6ca8-4b68-878a-dcdeb59f4712 response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
9412025-05-22T21:17:41.913ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
9422025-05-22T21:17:41.913ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
9432025-05-22T21:17:43.914ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9442025-05-22T21:17:43.914ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9452025-05-22T21:17:43.915ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9462025-05-22T21:17:43.915ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9472025-05-22T21:17:43.917ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9482025-05-22T21:17:43.920ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
9492025-05-22T21:17:43.920ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
9502025-05-22T21:17:44.036ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:36654
9512025-05-22T21:17:44.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 76f0fceb-3702-44f5-93d5-0b90be27b2c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9522025-05-22T21:17:44.037ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 76f0fceb-3702-44f5-93d5-0b90be27b2c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9532025-05-22T21:17:44.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 76f0fceb-3702-44f5-93d5-0b90be27b2c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9542025-05-22T21:17:44.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 44c7bda5-e53d-4d05-a287-825acdcf19e0 roles = RoleSet { roles: {} } uri = /sled-agents/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9552025-05-22T21:17:44.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 44c7bda5-e53d-4d05-a287-825acdcf19e0 resource = Database result = Ok(()) uri = /sled-agents/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9562025-05-22T21:17:44.047ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "cfb86abd-85e5-4869-9e83-7fe6eb951ca2" error_message_internal = not found: sled with id "cfb86abd-85e5-4869-9e83-7fe6eb951ca2" file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:855 latency_us = 3444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36654 req_id = 44c7bda5-e53d-4d05-a287-825acdcf19e0 response_code = 404 uri = /sled-agents/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9572025-05-22T21:17:44.516ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:49075
9582025-05-22T21:17:45.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c83444c0-0bce-4033-859f-a6ab74ede0b4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9592025-05-22T21:17:45.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c83444c0-0bce-4033-859f-a6ab74ede0b4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9602025-05-22T21:17:45.062ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3438 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c83444c0-0bce-4033-859f-a6ab74ede0b4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9612025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
9622025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
9632025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9642025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9652025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9662025-05-22T21:17:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9672025-05-22T21:17:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9682025-05-22T21:17:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9692025-05-22T21:17:45.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9702025-05-22T21:17:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9712025-05-22T21:17:45.090ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9722025-05-22T21:17:45.090ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.468716ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9732025-05-22T21:17:45.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9742025-05-22T21:17:45.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9752025-05-22T21:17:45.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.370281ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9762025-05-22T21:17:45.513ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:59 sled_uuid = cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9772025-05-22T21:17:45.545ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 39235 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bbe24328-066f-4ca5-9b23-e7cde791c55c response_code = 204 uri = /sled-agents/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
9782025-05-22T21:17:45.545ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
9792025-05-22T21:17:45.545ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9802025-05-22T21:17:45.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9812025-05-22T21:17:45.546ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822025-05-22T21:17:45.548ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
9832025-05-22T21:17:45.548ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
9842025-05-22T21:17:45.548ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
9852025-05-22T21:17:45.552ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(31c6c34e-4ed2-4633-809b-e8c3571ce575, 0), (c29d9385-2c49-41e7-b452-0bb7ca30dc03, 0), (9428e9c9-77d0-44b7-9cdd-7a41b09aa246, 0)]
9862025-05-22T21:17:45.553ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 974, tv_nsec: 697210258 } })
9872025-05-22T21:17:45.585ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
9882025-05-22T21:17:45.585ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
9892025-05-22T21:17:45.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
9902025-05-22T21:17:45.585ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cb84082-a802-40b2-939a-5b7e48e6dcee", "content-length": "476", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
9912025-05-22T21:17:45.585ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
9922025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "df1ed345-7305-4627-81d6-e003e66e6f30", "content-length": "734", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
9932025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
9942025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d2ceb92-a7a5-4e8d-a97b-cdf30ca11dd5", "content-length": "111", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
9952025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
9962025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5347fd69-c728-4698-a1f1-7e97462ad412", "content-length": "111", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
9972025-05-22T21:17:45.586ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
9982025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcd2f6dd-fba0-4f36-9b49-8ad4971327e1", "content-length": "170", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
9992025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
10002025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8cf5b31-62a9-4892-a758-03c9d3013fd9", "content-length": "170", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10012025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
10022025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6961de86-89ab-482e-8cb5-8fa93ea23e72", "content-length": "179", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10032025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
10042025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c49784b3-43d2-42dd-a9bc-ed54793986bd", "content-length": "179", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10052025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
10062025-05-22T21:17:45.587ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "20b23c6d-9f8e-44a0-b3a7-37f511146947", "content-length": "702", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10072025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10082025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee677c65-2e95-4c21-8277-5f51f7ea5b79", "content-length": "727", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10092025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10102025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddc71399-ffee-4c23-b643-2d8241dbbc12", "content-length": "729", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10112025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
10122025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2bee9be-b393-4b48-be9f-ed84c9a58bf7", "content-length": "728", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10132025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
10142025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcc88c6c-f76b-4f70-a475-f9464a4862a7", "content-length": "722", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10152025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
10162025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f928ffb7-8523-45d2-abdc-95fdc4851345", "content-length": "109", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10172025-05-22T21:17:45.588ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
10182025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "436f87a6-7cda-4f20-92c9-e3fa2a879b10", "content-length": "109", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10192025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
10202025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "445596a2-a23f-43e0-a1a5-37d1291908f8", "content-length": "169", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10212025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
10222025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "116c8882-c8d8-4400-a128-d54a2fb7bc55", "content-length": "169", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10232025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
10242025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "22ce4684-5f21-41a5-bfb4-692b12ccfb63", "content-length": "178", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10252025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
10262025-05-22T21:17:45.589ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "344230a6-547e-4e4a-9c3d-3ac5b15b11b2", "content-length": "178", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10272025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
10282025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e15d9ff8-afed-4fe7-ad13-cefe6b577ddc", "content-length": "702", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10292025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10302025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "392bfec2-5251-41f3-9eb8-f78196f6e87f", "content-length": "727", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10312025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10322025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8fed851c-0587-400f-b22c-fe588b8d5821", "content-length": "729", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10332025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
10342025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7d30101-5062-4136-ad23-f77f950ea3b1", "content-length": "728", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10352025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10362025-05-22T21:17:45.590ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10372025-05-22T21:17:45.592ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10382025-05-22T21:17:45.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10392025-05-22T21:17:45.594ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10402025-05-22T21:17:45.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10412025-05-22T21:17:45.596ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10422025-05-22T21:17:45.598ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
10432025-05-22T21:17:45.598ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10442025-05-22T21:17:45.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10452025-05-22T21:17:45.631ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
10462025-05-22T21:17:45.631ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
10472025-05-22T21:17:45.804ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "1c9540f2-2772-4148-a13f-87420bac2ab6", "content-length": "31959", "date": "Thu, 22 May 2025 21:17:45 GMT"} })
10482025-05-22T21:17:45.810ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10492025-05-22T21:17:45.810ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
10502025-05-22T21:17:45.810ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
10512025-05-22T21:17:45.811ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10522025-05-22T21:17:45.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10532025-05-22T21:17:45.813ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10542025-05-22T21:17:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
10552025-05-22T21:17:45.815ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
10562025-05-22T21:17:45.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
10572025-05-22T21:17:45.921ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10582025-05-22T21:17:45.921ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10592025-05-22T21:17:45.923ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10602025-05-22T21:17:45.923ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10612025-05-22T21:17:45.925ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622025-05-22T21:17:45.927ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
10632025-05-22T21:17:45.927ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
10642025-05-22T21:17:46.076ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c94c313a-01bd-4a3f-a71b-18283ddf2e19 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10652025-05-22T21:17:46.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c94c313a-01bd-4a3f-a71b-18283ddf2e19 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10662025-05-22T21:17:46.078ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c94c313a-01bd-4a3f-a71b-18283ddf2e19 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10672025-05-22T21:17:46.116ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 792becc0-bb84-40a0-8ca4-5b33a0fc21d4 file = nexus/db-queries/src/db/datastore/inventory.rs:1014
10682025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 792becc0-bb84-40a0-8ca4-5b33a0fc21d4 time_started = 2025-05-22 21:17:45.585396 UTC
10692025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 571.228151ms iteration = 2 status = {"collection_id":"792becc0-bb84-40a0-8ca4-5b33a0fc21d4","time_done":"2025-05-22 21:17:45.810340 UTC","time_started":"2025-05-22 21:17:45.585396 UTC"}
10702025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
10712025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
10722025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10732025-05-22T21:17:46.116ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
10742025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 31.19\u{b5}s iteration = 3 status = {"error":"no blueprint"}
10752025-05-22T21:17:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10762025-05-22T21:17:46.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10772025-05-22T21:17:46.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10782025-05-22T21:17:46.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10792025-05-22T21:17:46.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10802025-05-22T21:17:46.124ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:81 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
10812025-05-22T21:17:46.124ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 8.421595ms iteration = 3 status = {"error":"rack not yet initialized: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744"}
10822025-05-22T21:17:47.094ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 376bf3dc-ec29-4d79-9a80-30719b602e8d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10832025-05-22T21:17:47.094ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 376bf3dc-ec29-4d79-9a80-30719b602e8d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10842025-05-22T21:17:47.096ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 376bf3dc-ec29-4d79-9a80-30719b602e8d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10852025-05-22T21:17:47.929ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10862025-05-22T21:17:47.929ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10872025-05-22T21:17:47.931ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10882025-05-22T21:17:47.931ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10892025-05-22T21:17:47.933ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10902025-05-22T21:17:47.936ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
10912025-05-22T21:17:47.936ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, time_created: 2025-05-22T21:17:34.933341Z, time_modified: 2025-05-22T21:17:34.933341Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:772
10922025-05-22T21:17:48.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9694c21-84de-4507-a9b9-bf8429ac182c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10932025-05-22T21:17:48.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9694c21-84de-4507-a9b9-bf8429ac182c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10942025-05-22T21:17:48.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2139 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9694c21-84de-4507-a9b9-bf8429ac182c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10952025-05-22T21:17:49.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570ec7-d696-4bb2-9238-e98622cf46d5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10962025-05-22T21:17:49.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570ec7-d696-4bb2-9238-e98622cf46d5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10972025-05-22T21:17:49.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 13870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570ec7-d696-4bb2-9238-e98622cf46d5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
10982025-05-22T21:17:49.937ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10992025-05-22T21:17:49.938ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11002025-05-22T21:17:49.939ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11012025-05-22T21:17:49.939ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11022025-05-22T21:17:49.941ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11032025-05-22T21:17:49.944ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, lookup_type: ById(6591ad4d-a760-4e77-a3f6-8f4ecdb7c744) } result = Ok(())
11042025-05-22T21:17:49.944ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:769
11052025-05-22T21:17:49.944ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11062025-05-22T21:17:49.944ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11072025-05-22T21:17:49.946ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11082025-05-22T21:17:49.946ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11092025-05-22T21:17:49.948ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11102025-05-22T21:17:49.948ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11112025-05-22T21:17:49.950ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11122025-05-22T21:17:49.950ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11132025-05-22T21:17:49.951ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11142025-05-22T21:17:49.952ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11152025-05-22T21:17:49.953ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11162025-05-22T21:17:49.953ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11172025-05-22T21:17:49.954ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11182025-05-22T21:17:49.957ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11192025-05-22T21:17:49.958ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11202025-05-22T21:17:49.958ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11212025-05-22T21:17:49.959ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11222025-05-22T21:17:49.959ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11232025-05-22T21:17:49.961ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11242025-05-22T21:17:49.961ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11252025-05-22T21:17:49.962ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11262025-05-22T21:17:49.965ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11272025-05-22T21:17:49.965ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11282025-05-22T21:17:49.965ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11292025-05-22T21:17:49.967ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11302025-05-22T21:17:49.968ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11312025-05-22T21:17:49.969ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11322025-05-22T21:17:49.969ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11332025-05-22T21:17:49.971ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11342025-05-22T21:17:49.971ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11352025-05-22T21:17:49.972ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11362025-05-22T21:17:49.973ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11372025-05-22T21:17:49.974ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11382025-05-22T21:17:49.974ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11392025-05-22T21:17:49.976ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11402025-05-22T21:17:49.976ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11412025-05-22T21:17:49.977ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11422025-05-22T21:17:49.980ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
11432025-05-22T21:17:49.980ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11442025-05-22T21:17:49.980ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11452025-05-22T21:17:49.982ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11462025-05-22T21:17:49.982ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11472025-05-22T21:17:49.984ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11482025-05-22T21:17:49.984ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11492025-05-22T21:17:49.986ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11502025-05-22T21:17:49.986ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11512025-05-22T21:17:49.988ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11522025-05-22T21:17:49.988ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11532025-05-22T21:17:49.989ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11542025-05-22T21:17:49.989ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11552025-05-22T21:17:49.991ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11562025-05-22T21:17:49.991ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11572025-05-22T21:17:49.995ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11582025-05-22T21:17:49.999ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11592025-05-22T21:17:49.999ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11602025-05-22T21:17:49.999ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11612025-05-22T21:17:50.000ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11622025-05-22T21:17:50.000ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11632025-05-22T21:17:50.002ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11642025-05-22T21:17:50.002ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11652025-05-22T21:17:50.004ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11662025-05-22T21:17:50.007ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
11672025-05-22T21:17:50.007ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11682025-05-22T21:17:50.007ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11692025-05-22T21:17:50.011ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11702025-05-22T21:17:50.012ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11712025-05-22T21:17:50.013ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11722025-05-22T21:17:50.014ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11732025-05-22T21:17:50.015ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11742025-05-22T21:17:50.016ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11752025-05-22T21:17:50.018ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11762025-05-22T21:17:50.018ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11772025-05-22T21:17:50.020ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11782025-05-22T21:17:50.021ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11792025-05-22T21:17:50.022ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11802025-05-22T21:17:50.022ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11812025-05-22T21:17:50.023ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11822025-05-22T21:17:50.023ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11832025-05-22T21:17:50.025ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11842025-05-22T21:17:50.028ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11852025-05-22T21:17:50.028ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11862025-05-22T21:17:50.028ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11872025-05-22T21:17:50.030ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11882025-05-22T21:17:50.030ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11892025-05-22T21:17:50.032ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11902025-05-22T21:17:50.032ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11912025-05-22T21:17:50.033ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11922025-05-22T21:17:50.036ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
11932025-05-22T21:17:50.036ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11942025-05-22T21:17:50.036ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11952025-05-22T21:17:50.044ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
11962025-05-22T21:17:50.044ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
11972025-05-22T21:17:50.044ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
11982025-05-22T21:17:50.045ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11992025-05-22T21:17:50.047ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
12002025-05-22T21:17:50.047ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12012025-05-22T21:17:50.047ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12022025-05-22T21:17:50.056ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
12032025-05-22T21:17:50.058ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
12042025-05-22T21:17:50.058ZDEBGnexus (InternalApi): resolved 2 rules for sleds
12052025-05-22T21:17:50.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05ff655c-4820-4db8-8cca-64151cbd4bc9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12062025-05-22T21:17:50.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05ff655c-4820-4db8-8cca-64151cbd4bc9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12072025-05-22T21:17:50.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05ff655c-4820-4db8-8cca-64151cbd4bc9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12082025-05-22T21:17:50.199ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, time_created: 2025-05-22T21:17:45.513933Z, time_modified: 2025-05-22T21:17:45.513933Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
12092025-05-22T21:17:50.199ZDEBGnexus (InternalApi): sending firewall rules to sled agents
12102025-05-22T21:17:50.230ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12112025-05-22T21:17:50.231ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12122025-05-22T21:17:50.233ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
12132025-05-22T21:17:50.233ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
12142025-05-22T21:17:50.234ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12152025-05-22T21:17:50.237ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
12162025-05-22T21:17:50.237ZDEBGnexus (InternalApi): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
12172025-05-22T21:17:50.238ZDEBGnexus (InternalApi): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "84d8fdc7-1d46-480d-825a-1522c3b9b540", "date": "Thu, 22 May 2025 21:17:49 GMT"} })
12182025-05-22T21:17:50.238ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:495
12192025-05-22T21:17:50.238ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
12202025-05-22T21:17:51.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6dd5b48-366e-4058-8e53-dadf15630b9e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12212025-05-22T21:17:51.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6dd5b48-366e-4058-8e53-dadf15630b9e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12222025-05-22T21:17:51.173ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6dd5b48-366e-4058-8e53-dadf15630b9e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12232025-05-22T21:17:52.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be6cdbd5-a9c7-4a85-bba8-0d061ac218cb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12242025-05-22T21:17:52.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be6cdbd5-a9c7-4a85-bba8-0d061ac218cb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12252025-05-22T21:17:52.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be6cdbd5-a9c7-4a85-bba8-0d061ac218cb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12262025-05-22T21:17:53.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d7f50658-2287-4ae0-afbd-58c9f3be95a0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12272025-05-22T21:17:53.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d7f50658-2287-4ae0-afbd-58c9f3be95a0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12282025-05-22T21:17:53.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2123 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d7f50658-2287-4ae0-afbd-58c9f3be95a0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12292025-05-22T21:17:54.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 609379a9-2749-4e1a-bd15-c2e64a278ce0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12302025-05-22T21:17:54.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 609379a9-2749-4e1a-bd15-c2e64a278ce0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12312025-05-22T21:17:54.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 609379a9-2749-4e1a-bd15-c2e64a278ce0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12322025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
12332025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12342025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
12352025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12362025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12372025-05-22T21:17:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12382025-05-22T21:17:55.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
12392025-05-22T21:17:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
12402025-05-22T21:17:55.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12412025-05-22T21:17:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
12422025-05-22T21:17:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12432025-05-22T21:17:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12442025-05-22T21:17:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12452025-05-22T21:17:55.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12462025-05-22T21:17:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12472025-05-22T21:17:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
12482025-05-22T21:17:55.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
12492025-05-22T21:17:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
12502025-05-22T21:17:55.115ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
12512025-05-22T21:17:55.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.306766ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z","time_found":"2025-05-22T21:17:55.115710384Z"}
12522025-05-22T21:17:55.115ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
12532025-05-22T21:17:55.115ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
12542025-05-22T21:17:55.115ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
12552025-05-22T21:17:55.115ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 7.56\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
12562025-05-22T21:17:55.115ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12572025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12582025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12592025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12602025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12612025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12622025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12632025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12642025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12652025-05-22T21:17:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12662025-05-22T21:17:55.118ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12672025-05-22T21:17:55.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.754582ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
12682025-05-22T21:17:55.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12692025-05-22T21:17:55.120ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12702025-05-22T21:17:55.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12712025-05-22T21:17:55.121ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12722025-05-22T21:17:55.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12732025-05-22T21:17:55.123ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12742025-05-22T21:17:55.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12752025-05-22T21:17:55.123ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12762025-05-22T21:17:55.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12772025-05-22T21:17:55.125ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12782025-05-22T21:17:55.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12792025-05-22T21:17:55.127ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12802025-05-22T21:17:55.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12812025-05-22T21:17:55.130ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12822025-05-22T21:17:55.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12832025-05-22T21:17:55.130ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12842025-05-22T21:17:55.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
12852025-05-22T21:17:55.132ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
12862025-05-22T21:17:55.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
12872025-05-22T21:17:55.166ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
12882025-05-22T21:17:55.200ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
12892025-05-22T21:17:55.231ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
12902025-05-22T21:17:55.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e308ef1-d644-48a6-8559-3f7ee7c23baf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12912025-05-22T21:17:55.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e308ef1-d644-48a6-8559-3f7ee7c23baf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12922025-05-22T21:17:55.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e308ef1-d644-48a6-8559-3f7ee7c23baf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12932025-05-22T21:17:55.263ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
12942025-05-22T21:17:55.298ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
12952025-05-22T21:17:56.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77f1206a-03cc-450d-92ea-6b5acd7f4136 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12962025-05-22T21:17:56.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77f1206a-03cc-450d-92ea-6b5acd7f4136 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12972025-05-22T21:17:56.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77f1206a-03cc-450d-92ea-6b5acd7f4136 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
12982025-05-22T21:17:56.334ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee8bb9cd-edf9-4858-a985-3eab43f7c623", "content-length": "64", "date": "Thu, 22 May 2025 21:17:56 GMT"} })
12992025-05-22T21:17:56.334ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13002025-05-22T21:17:56.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13012025-05-22T21:17:56.336ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13022025-05-22T21:17:56.337ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13032025-05-22T21:17:56.337ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13042025-05-22T21:17:56.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13052025-05-22T21:17:56.338ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf468e70-254e-4f90-9b49-39ab402b5c7e", "content-length": "64", "date": "Thu, 22 May 2025 21:17:56 GMT"} })
13062025-05-22T21:17:56.338ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13072025-05-22T21:17:56.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13082025-05-22T21:17:56.340ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092025-05-22T21:17:56.341ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13102025-05-22T21:17:56.341ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13112025-05-22T21:17:56.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13122025-05-22T21:17:56.346ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c994638-76d9-4dbf-9e93-92971c4fc11e", "content-length": "64", "date": "Thu, 22 May 2025 21:17:56 GMT"} })
13132025-05-22T21:17:56.346ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13142025-05-22T21:17:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13152025-05-22T21:17:56.348ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13162025-05-22T21:17:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13172025-05-22T21:17:56.349ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13182025-05-22T21:17:56.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13192025-05-22T21:17:56.352ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3ee0a13-2138-401c-9f01-b3b893aadb0c", "content-length": "64", "date": "Thu, 22 May 2025 21:17:56 GMT"} })
13202025-05-22T21:17:56.352ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13212025-05-22T21:17:56.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13222025-05-22T21:17:56.354ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13232025-05-22T21:17:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13242025-05-22T21:17:56.355ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13252025-05-22T21:17:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13262025-05-22T21:17:56.402ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d3d7c041-2dad-48d6-aad2-4becbbac8c45", "content-length": "64", "date": "Thu, 22 May 2025 21:17:56 GMT"} })
13272025-05-22T21:17:56.402ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13282025-05-22T21:17:56.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13292025-05-22T21:17:56.404ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13302025-05-22T21:17:56.405ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
13312025-05-22T21:17:56.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
13322025-05-22T21:17:56.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
13332025-05-22T21:17:56.410ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.294754228s iteration = 2 status = {"nsuccess":5}
13342025-05-22T21:17:57.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b23509fa-1ffb-4ede-b46c-f17a222edb79 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13352025-05-22T21:17:57.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b23509fa-1ffb-4ede-b46c-f17a222edb79 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13362025-05-22T21:17:57.274ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1656 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b23509fa-1ffb-4ede-b46c-f17a222edb79 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13372025-05-22T21:17:58.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fede6492-6aa9-4b83-b2de-53f69d3ed1e6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13382025-05-22T21:17:58.290ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fede6492-6aa9-4b83-b2de-53f69d3ed1e6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13392025-05-22T21:17:58.292ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fede6492-6aa9-4b83-b2de-53f69d3ed1e6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13402025-05-22T21:17:59.307ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b9cba44-48a6-49ab-a48a-1fda7a6cc491 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13412025-05-22T21:17:59.307ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b9cba44-48a6-49ab-a48a-1fda7a6cc491 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13422025-05-22T21:17:59.310ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2707 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b9cba44-48a6-49ab-a48a-1fda7a6cc491 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13432025-05-22T21:18:00.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c03e21ba-8079-47e7-9a52-eecfc2a7bfca roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13442025-05-22T21:18:00.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c03e21ba-8079-47e7-9a52-eecfc2a7bfca resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13452025-05-22T21:18:00.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c03e21ba-8079-47e7-9a52-eecfc2a7bfca response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13462025-05-22T21:18:01.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 707ffef8-b20d-48bc-9967-6a017cb5ad57 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13472025-05-22T21:18:01.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 707ffef8-b20d-48bc-9967-6a017cb5ad57 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13482025-05-22T21:18:01.343ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2027 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 707ffef8-b20d-48bc-9967-6a017cb5ad57 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13492025-05-22T21:18:02.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93690bbc-531e-4775-b4eb-28bdd5f3d811 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13502025-05-22T21:18:02.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93690bbc-531e-4775-b4eb-28bdd5f3d811 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13512025-05-22T21:18:02.358ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2192 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93690bbc-531e-4775-b4eb-28bdd5f3d811 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13522025-05-22T21:18:03.152ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:35416
13532025-05-22T21:18:03.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 1b1cc7d3-0ee7-4c98-b1e8-7c002fbdaefc roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
13542025-05-22T21:18:03.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 1b1cc7d3-0ee7-4c98-b1e8-7c002fbdaefc resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
13552025-05-22T21:18:03.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 13059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 1b1cc7d3-0ee7-4c98-b1e8-7c002fbdaefc response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
13562025-05-22T21:18:03.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 23b9bd3e-7d15-47dc-b9af-003cecbd5614 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNWM1NmM4NS03NWUxLTQ1OGEtOTQ1My02YzE0MjgxMjY5ZGEifX0%3D
13572025-05-22T21:18:03.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 23b9bd3e-7d15-47dc-b9af-003cecbd5614 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNWM1NmM4NS03NWUxLTQ1OGEtOTQ1My02YzE0MjgxMjY5ZGEifX0%3D
13582025-05-22T21:18:03.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2932 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 23b9bd3e-7d15-47dc-b9af-003cecbd5614 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiIxNWM1NmM4NS03NWUxLTQ1OGEtOTQ1My02YzE0MjgxMjY5ZGEifX0%3D
13592025-05-22T21:18:03.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e167b2e-c876-4f01-9d2f-e76d5b1ec4f1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13602025-05-22T21:18:03.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e167b2e-c876-4f01-9d2f-e76d5b1ec4f1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13612025-05-22T21:18:03.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1930 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7e167b2e-c876-4f01-9d2f-e76d5b1ec4f1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13622025-05-22T21:18:04.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 294667a7-25cb-4b6f-a563-3d359ee55634 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13632025-05-22T21:18:04.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 294667a7-25cb-4b6f-a563-3d359ee55634 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13642025-05-22T21:18:04.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1737 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 294667a7-25cb-4b6f-a563-3d359ee55634 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
13652025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
13662025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13672025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
13682025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
13692025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
13702025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
13712025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
13722025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
13732025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
13742025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
13752025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
13762025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
13772025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
13782025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
13792025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
13802025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
13812025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
13822025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
13832025-05-22T21:18:05.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
13842025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
13852025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
13862025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
13872025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
13882025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
13892025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
13902025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13912025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 2 reason = Timeout
13922025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
13932025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
13942025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
13952025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
13962025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
13972025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
13982025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
13992025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
14002025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
14012025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14022025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
14032025-05-22T21:18:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
14042025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14052025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
14062025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14072025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14082025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14092025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
14102025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14112025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
14122025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14132025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14142025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14152025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14162025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14172025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
14182025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14192025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14202025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
14212025-05-22T21:18:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
14222025-05-22T21:18:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.964228ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
14232025-05-22T21:18:05.088ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 232572530 } })
14242025-05-22T21:18:05.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
14252025-05-22T21:18:05.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14262025-05-22T21:18:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
14272025-05-22T21:18:05.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
14282025-05-22T21:18:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
14292025-05-22T21:18:05.095ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14302025-05-22T21:18:05.097ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
14312025-05-22T21:18:05.097ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
14322025-05-22T21:18:05.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
14332025-05-22T21:18:05.097ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14342025-05-22T21:18:05.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14352025-05-22T21:18:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14362025-05-22T21:18:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
14372025-05-22T21:18:05.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
14382025-05-22T21:18:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
14392025-05-22T21:18:05.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14402025-05-22T21:18:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14412025-05-22T21:18:05.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14422025-05-22T21:18:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14432025-05-22T21:18:05.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14442025-05-22T21:18:05.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14452025-05-22T21:18:05.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14462025-05-22T21:18:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
14472025-05-22T21:18:05.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14482025-05-22T21:18:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14492025-05-22T21:18:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
14502025-05-22T21:18:05.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
14512025-05-22T21:18:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
14522025-05-22T21:18:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
14532025-05-22T21:18:05.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14542025-05-22T21:18:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14552025-05-22T21:18:05.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14562025-05-22T21:18:05.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
14572025-05-22T21:18:05.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
14582025-05-22T21:18:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
14592025-05-22T21:18:05.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 262999383 } })
14602025-05-22T21:18:05.119ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
14612025-05-22T21:18:05.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14622025-05-22T21:18:05.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14632025-05-22T21:18:05.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
14642025-05-22T21:18:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
14652025-05-22T21:18:05.127ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 268536716 } })
14662025-05-22T21:18:05.127ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
14672025-05-22T21:18:05.128ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
14682025-05-22T21:18:05.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
14692025-05-22T21:18:05.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702025-05-22T21:18:05.135ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
14712025-05-22T21:18:05.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14722025-05-22T21:18:05.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14732025-05-22T21:18:05.145ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14742025-05-22T21:18:05.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14752025-05-22T21:18:05.150ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-05-22T21:18:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
14772025-05-22T21:18:05.154ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
14782025-05-22T21:18:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
14792025-05-22T21:18:05.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
14802025-05-22T21:18:05.159ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
14812025-05-22T21:18:05.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
14822025-05-22T21:18:05.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.975451ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
14832025-05-22T21:18:05.161ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.178458ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
14842025-05-22T21:18:05.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.553344ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14852025-05-22T21:18:05.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
14862025-05-22T21:18:05.165ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
14872025-05-22T21:18:05.166ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "077f2578-f33b-4598-91bc-c7e3fb105bba", "content-length": "26", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
14882025-05-22T21:18:05.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
14892025-05-22T21:18:05.167ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
14902025-05-22T21:18:05.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 85.32281ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
14912025-05-22T21:18:05.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14922025-05-22T21:18:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14932025-05-22T21:18:05.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 87.126367ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
14942025-05-22T21:18:05.171ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
14952025-05-22T21:18:05.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14962025-05-22T21:18:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
14972025-05-22T21:18:05.172ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 87.950619ms iteration = 2 status = {"errors":[],"requests_created_ok":[]}
14982025-05-22T21:18:05.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 89.742366ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
14992025-05-22T21:18:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
15002025-05-22T21:18:05.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
15012025-05-22T21:18:05.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
15022025-05-22T21:18:05.176ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15032025-05-22T21:18:05.176ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
15042025-05-22T21:18:05.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
15052025-05-22T21:18:05.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
15062025-05-22T21:18:05.177ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
15072025-05-22T21:18:05.177ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 93.38573ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
15082025-05-22T21:18:05.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 109.603741ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15092025-05-22T21:18:05.204ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15102025-05-22T21:18:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15112025-05-22T21:18:05.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15122025-05-22T21:18:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15132025-05-22T21:18:05.206ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15142025-05-22T21:18:05.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15152025-05-22T21:18:05.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15162025-05-22T21:18:05.208ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15172025-05-22T21:18:05.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
15182025-05-22T21:18:05.210ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
15192025-05-22T21:18:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
15202025-05-22T21:18:05.212ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
15212025-05-22T21:18:05.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15222025-05-22T21:18:05.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15232025-05-22T21:18:05.213ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
15242025-05-22T21:18:05.213ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15252025-05-22T21:18:05.214ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a40ce7c-9c1c-4b12-bc63-e4034372366e", "content-length": "26", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15262025-05-22T21:18:05.214ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15272025-05-22T21:18:05.215ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
15282025-05-22T21:18:05.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15292025-05-22T21:18:05.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15302025-05-22T21:18:05.228ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15312025-05-22T21:18:05.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15322025-05-22T21:18:05.230ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
15332025-05-22T21:18:05.230ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15342025-05-22T21:18:05.230ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46040d17-e84f-41ac-8cb4-09737189cad0", "content-length": "26", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15352025-05-22T21:18:05.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15362025-05-22T21:18:05.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15372025-05-22T21:18:05.234ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
15382025-05-22T21:18:05.234ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
15392025-05-22T21:18:05.234ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 149.544085ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
15402025-05-22T21:18:05.238ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15412025-05-22T21:18:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15422025-05-22T21:18:05.252ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15432025-05-22T21:18:05.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15442025-05-22T21:18:05.255ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 170.610668ms iteration = 2 status = {}
15452025-05-22T21:18:05.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15462025-05-22T21:18:05.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15472025-05-22T21:18:05.258ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
15482025-05-22T21:18:05.258ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 174.08876ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
15492025-05-22T21:18:05.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15502025-05-22T21:18:05.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15512025-05-22T21:18:05.270ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
15522025-05-22T21:18:05.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
15532025-05-22T21:18:05.282ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 994, tv_nsec: 425674523 } })
15542025-05-22T21:18:05.282ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1178
15552025-05-22T21:18:05.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15562025-05-22T21:18:05.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15572025-05-22T21:18:05.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15582025-05-22T21:18:05.303ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15592025-05-22T21:18:05.303ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15602025-05-22T21:18:05.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15612025-05-22T21:18:05.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15622025-05-22T21:18:05.307ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 223.14605ms iteration = 4 status = {"physical_disks_added":0}
15632025-05-22T21:18:05.308ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
15642025-05-22T21:18:05.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
15652025-05-22T21:18:05.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
15662025-05-22T21:18:05.331ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
15672025-05-22T21:18:05.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
15682025-05-22T21:18:05.333ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 249.048775ms iteration = 2 status = null
15692025-05-22T21:18:05.360ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
15702025-05-22T21:18:05.360ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
15712025-05-22T21:18:05.360ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "0aa01777-d83a-4bb8-adc9-de810479367b", "content-length": "372", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15722025-05-22T21:18:05.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15732025-05-22T21:18:05.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15742025-05-22T21:18:05.404ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
15752025-05-22T21:18:05.413ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
15762025-05-22T21:18:05.413ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
15772025-05-22T21:18:05.413ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "433889cd-11fc-48b6-b311-7e19bd3a3651", "content-length": "26", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15782025-05-22T21:18:05.413ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
15792025-05-22T21:18:05.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
15802025-05-22T21:18:05.416ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
15812025-05-22T21:18:05.417ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
15822025-05-22T21:18:05.471ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15832025-05-22T21:18:05.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15842025-05-22T21:18:05.478ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 393.396654ms iteration = 2 status = 6
15852025-05-22T21:18:05.480ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
15862025-05-22T21:18:05.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
15872025-05-22T21:18:05.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
15882025-05-22T21:18:05.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd042e6f-5324-4300-8b2b-a94685ca6427 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
15892025-05-22T21:18:05.563ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3f2be570-f0c0-4288-9368-683e4979e7c9", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15902025-05-22T21:18:05.563ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
15912025-05-22T21:18:05.564ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cf4a8f7-ee9c-4c4d-9950-fbb6b425d293", "content-length": "691", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
15922025-05-22T21:18:05.564ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
15932025-05-22T21:18:05.564ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
15942025-05-22T21:18:05.564ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
15952025-05-22T21:18:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
15962025-05-22T21:18:05.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd042e6f-5324-4300-8b2b-a94685ca6427 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
15972025-05-22T21:18:05.565ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.007358ms iteration = 2 status = {}
15982025-05-22T21:18:05.566ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
15992025-05-22T21:18:05.566ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
16002025-05-22T21:18:05.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16012025-05-22T21:18:05.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd042e6f-5324-4300-8b2b-a94685ca6427 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16022025-05-22T21:18:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16032025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
16042025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
16052025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16062025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16072025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16082025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16092025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
16102025-05-22T21:18:05.569ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
16112025-05-22T21:18:05.570ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
16122025-05-22T21:18:05.570ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16132025-05-22T21:18:05.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16142025-05-22T21:18:05.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16152025-05-22T21:18:05.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16162025-05-22T21:18:05.586ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
16172025-05-22T21:18:05.586ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
16182025-05-22T21:18:05.594ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
16192025-05-22T21:18:05.594ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
16202025-05-22T21:18:05.713ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "697afa2f-a8a6-430c-b835-ad3bc292173a", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
16212025-05-22T21:18:05.713ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
16222025-05-22T21:18:05.713ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
16232025-05-22T21:18:05.714ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3979c37-4c1c-4c4b-88a2-65a391244658", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
16242025-05-22T21:18:05.716ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 631.837232ms iteration = 2 status = {}
16252025-05-22T21:18:05.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53e039f-005d-43c5-82a0-f11ab906c87f", "content-length": "682", "date": "Thu, 22 May 2025 21:18:05 GMT"} })
16262025-05-22T21:18:05.719ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16272025-05-22T21:18:05.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16282025-05-22T21:18:05.723ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16292025-05-22T21:18:05.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16302025-05-22T21:18:05.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16312025-05-22T21:18:05.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16322025-05-22T21:18:05.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16332025-05-22T21:18:05.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16342025-05-22T21:18:05.752ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 667.735077ms iteration = 2 status = {}
16352025-05-22T21:18:05.934ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 59158c2a-9867-4834-96ae-eedad98046ad roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/0?limit=100
16362025-05-22T21:18:05.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 59158c2a-9867-4834-96ae-eedad98046ad resource = Database result = Ok(()) uri = /nat/ipv4/changeset/0?limit=100
16372025-05-22T21:18:05.939ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4891 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 59158c2a-9867-4834-96ae-eedad98046ad response_code = 200 uri = /nat/ipv4/changeset/0?limit=100
16382025-05-22T21:18:05.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 3f2f79a7-4c79-471f-8655-7ffd1e6ad2cc roles = RoleSet { roles: {} } uri = /nat/ipv4/changeset/6?limit=100
16392025-05-22T21:18:05.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 3f2f79a7-4c79-471f-8655-7ffd1e6ad2cc resource = Database result = Ok(()) uri = /nat/ipv4/changeset/6?limit=100
16402025-05-22T21:18:05.946ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 4797 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::2]:45425 req_id = 3f2f79a7-4c79-471f-8655-7ffd1e6ad2cc response_code = 200 uri = /nat/ipv4/changeset/6?limit=100
16412025-05-22T21:18:06.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b0fea598-52cb-4480-b192-60b4ff5734f4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16422025-05-22T21:18:06.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b0fea598-52cb-4480-b192-60b4ff5734f4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16432025-05-22T21:18:06.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b0fea598-52cb-4480-b192-60b4ff5734f4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16442025-05-22T21:18:07.737ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dfb11a7b-61a7-472c-8fd0-0771226cad11 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16452025-05-22T21:18:07.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dfb11a7b-61a7-472c-8fd0-0771226cad11 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16462025-05-22T21:18:07.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2831 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dfb11a7b-61a7-472c-8fd0-0771226cad11 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16472025-05-22T21:18:08.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dac1b9c2-ca47-4ccc-a2cd-d0a14a8ea55e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16482025-05-22T21:18:08.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dac1b9c2-ca47-4ccc-a2cd-d0a14a8ea55e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16492025-05-22T21:18:08.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dac1b9c2-ca47-4ccc-a2cd-d0a14a8ea55e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16502025-05-22T21:18:09.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d62bd61-c00c-4d2a-a3d2-7d25c2defd26 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16512025-05-22T21:18:09.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d62bd61-c00c-4d2a-a3d2-7d25c2defd26 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16522025-05-22T21:18:09.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2728 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d62bd61-c00c-4d2a-a3d2-7d25c2defd26 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16532025-05-22T21:18:10.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14939bbc-4eeb-4402-89ba-5497c298b23e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16542025-05-22T21:18:10.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14939bbc-4eeb-4402-89ba-5497c298b23e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16552025-05-22T21:18:10.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14939bbc-4eeb-4402-89ba-5497c298b23e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16562025-05-22T21:18:11.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15284ba7-3b59-4e6a-8546-0e5020116855 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16572025-05-22T21:18:11.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15284ba7-3b59-4e6a-8546-0e5020116855 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16582025-05-22T21:18:11.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1743 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15284ba7-3b59-4e6a-8546-0e5020116855 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16592025-05-22T21:18:12.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72f6fdc9-65d3-49fd-baf3-a2a126236928 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16602025-05-22T21:18:12.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72f6fdc9-65d3-49fd-baf3-a2a126236928 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16612025-05-22T21:18:12.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72f6fdc9-65d3-49fd-baf3-a2a126236928 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16622025-05-22T21:18:13.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e37ee9e-86f6-4a5f-a544-e77f199435ea roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16632025-05-22T21:18:13.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e37ee9e-86f6-4a5f-a544-e77f199435ea resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16642025-05-22T21:18:13.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e37ee9e-86f6-4a5f-a544-e77f199435ea response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16652025-05-22T21:18:14.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e555092-0b45-4aca-ada5-289ff3ba1101 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16662025-05-22T21:18:14.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e555092-0b45-4aca-ada5-289ff3ba1101 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16672025-05-22T21:18:14.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2254 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e555092-0b45-4aca-ada5-289ff3ba1101 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16682025-05-22T21:18:15.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
16692025-05-22T21:18:15.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
16702025-05-22T21:18:15.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16712025-05-22T21:18:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16722025-05-22T21:18:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16732025-05-22T21:18:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16742025-05-22T21:18:15.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16752025-05-22T21:18:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16762025-05-22T21:18:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16772025-05-22T21:18:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
16782025-05-22T21:18:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16792025-05-22T21:18:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16802025-05-22T21:18:15.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16812025-05-22T21:18:15.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16822025-05-22T21:18:15.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.535979ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
16832025-05-22T21:18:15.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16842025-05-22T21:18:15.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
16852025-05-22T21:18:15.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16862025-05-22T21:18:15.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16872025-05-22T21:18:15.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
16882025-05-22T21:18:15.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.322693ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
16892025-05-22T21:18:15.864ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dea2b83f-c78e-491e-9086-b9efb35d4d91 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16902025-05-22T21:18:15.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dea2b83f-c78e-491e-9086-b9efb35d4d91 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16912025-05-22T21:18:15.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dea2b83f-c78e-491e-9086-b9efb35d4d91 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16922025-05-22T21:18:16.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 537f2d84-5df0-4ea0-8d09-2f470db41eff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16932025-05-22T21:18:16.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 537f2d84-5df0-4ea0-8d09-2f470db41eff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16942025-05-22T21:18:16.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 537f2d84-5df0-4ea0-8d09-2f470db41eff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16952025-05-22T21:18:17.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6316b7e-aa19-4873-afdc-ab80f68ac6d4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16962025-05-22T21:18:17.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6316b7e-aa19-4873-afdc-ab80f68ac6d4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16972025-05-22T21:18:17.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6316b7e-aa19-4873-afdc-ab80f68ac6d4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16982025-05-22T21:18:18.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c886d98f-3839-4fdc-adbf-afa0348c8ec8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
16992025-05-22T21:18:18.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c886d98f-3839-4fdc-adbf-afa0348c8ec8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17002025-05-22T21:18:18.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c886d98f-3839-4fdc-adbf-afa0348c8ec8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17012025-05-22T21:18:19.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18a03685-f6b7-4f38-8dc2-d976d9788c88 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17022025-05-22T21:18:19.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18a03685-f6b7-4f38-8dc2-d976d9788c88 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17032025-05-22T21:18:19.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18a03685-f6b7-4f38-8dc2-d976d9788c88 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17042025-05-22T21:18:20.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d09af8d-308d-4912-a0b8-ad9b8110bc78 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17052025-05-22T21:18:20.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d09af8d-308d-4912-a0b8-ad9b8110bc78 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17062025-05-22T21:18:20.944ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1531 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d09af8d-308d-4912-a0b8-ad9b8110bc78 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17072025-05-22T21:18:21.957ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 373f49d4-02e2-49c6-8145-6080209f5834 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17082025-05-22T21:18:21.958ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 373f49d4-02e2-49c6-8145-6080209f5834 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17092025-05-22T21:18:21.960ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 373f49d4-02e2-49c6-8145-6080209f5834 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17102025-05-22T21:18:22.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2255a07b-368c-449c-a822-218e91352e1b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17112025-05-22T21:18:22.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2255a07b-368c-449c-a822-218e91352e1b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17122025-05-22T21:18:22.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2255a07b-368c-449c-a822-218e91352e1b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17132025-05-22T21:18:23.988ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56855e3-9b61-4ddb-9c0f-a9cc8009659e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17142025-05-22T21:18:23.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56855e3-9b61-4ddb-9c0f-a9cc8009659e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17152025-05-22T21:18:23.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3026 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56855e3-9b61-4ddb-9c0f-a9cc8009659e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17162025-05-22T21:18:25.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 998e2467-fb55-49da-b67f-22d314eb51c9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17172025-05-22T21:18:25.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 998e2467-fb55-49da-b67f-22d314eb51c9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17182025-05-22T21:18:25.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2189 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 998e2467-fb55-49da-b67f-22d314eb51c9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17192025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
17202025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
17212025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17222025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17232025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17242025-05-22T21:18:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17252025-05-22T21:18:25.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17262025-05-22T21:18:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17272025-05-22T21:18:25.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17282025-05-22T21:18:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17292025-05-22T21:18:25.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17302025-05-22T21:18:25.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17312025-05-22T21:18:25.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17322025-05-22T21:18:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
17332025-05-22T21:18:25.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17342025-05-22T21:18:25.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17352025-05-22T21:18:25.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
17362025-05-22T21:18:25.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.419954ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
17372025-05-22T21:18:25.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17382025-05-22T21:18:25.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17392025-05-22T21:18:25.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.049627ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17402025-05-22T21:18:26.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b3cb993-5fe5-4e67-bca8-5feae9c3b185 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17412025-05-22T21:18:26.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b3cb993-5fe5-4e67-bca8-5feae9c3b185 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17422025-05-22T21:18:26.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b3cb993-5fe5-4e67-bca8-5feae9c3b185 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17432025-05-22T21:18:27.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e040f26-9b2c-471a-9233-cb9596efd7f5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17442025-05-22T21:18:27.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e040f26-9b2c-471a-9233-cb9596efd7f5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17452025-05-22T21:18:27.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e040f26-9b2c-471a-9233-cb9596efd7f5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17462025-05-22T21:18:28.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5252737c-c3cf-48ac-b73f-c20cceec37f6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17472025-05-22T21:18:28.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5252737c-c3cf-48ac-b73f-c20cceec37f6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17482025-05-22T21:18:28.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 105913 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5252737c-c3cf-48ac-b73f-c20cceec37f6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17492025-05-22T21:18:29.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37ad6f0d-a851-40ff-8c44-b12c5741077c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17502025-05-22T21:18:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37ad6f0d-a851-40ff-8c44-b12c5741077c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17512025-05-22T21:18:29.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 96563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37ad6f0d-a851-40ff-8c44-b12c5741077c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17522025-05-22T21:18:30.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 161ff1c3-3ede-492d-9723-dcb94dfa7cee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17532025-05-22T21:18:30.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 161ff1c3-3ede-492d-9723-dcb94dfa7cee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17542025-05-22T21:18:30.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 100299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 161ff1c3-3ede-492d-9723-dcb94dfa7cee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17552025-05-22T21:18:31.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c82962bc-6014-419b-a4ab-74f45c5b2800 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17562025-05-22T21:18:31.395ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c82962bc-6014-419b-a4ab-74f45c5b2800 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17572025-05-22T21:18:31.397ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c82962bc-6014-419b-a4ab-74f45c5b2800 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17582025-05-22T21:18:32.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e58fafd-07dd-4ed3-a01e-8ff1179c0955 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17592025-05-22T21:18:32.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e58fafd-07dd-4ed3-a01e-8ff1179c0955 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17602025-05-22T21:18:32.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e58fafd-07dd-4ed3-a01e-8ff1179c0955 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17612025-05-22T21:18:33.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 0d85188f-8994-4047-b5bf-b382d7e914b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
17622025-05-22T21:18:33.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 0d85188f-8994-4047-b5bf-b382d7e914b2 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
17632025-05-22T21:18:33.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 0d85188f-8994-4047-b5bf-b382d7e914b2 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
17642025-05-22T21:18:33.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = fe4ac789-11d7-4dc5-873a-7660bd97dffb roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI0NmVlYzhmNi0zMjA1LTQ4YmMtYTBiNC05ZDAyY2QwMzJhNGEifX0%3D
17652025-05-22T21:18:33.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = fe4ac789-11d7-4dc5-873a-7660bd97dffb resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI0NmVlYzhmNi0zMjA1LTQ4YmMtYTBiNC05ZDAyY2QwMzJhNGEifX0%3D
17662025-05-22T21:18:33.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2521 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = fe4ac789-11d7-4dc5-873a-7660bd97dffb response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI0NmVlYzhmNi0zMjA1LTQ4YmMtYTBiNC05ZDAyY2QwMzJhNGEifX0%3D
17672025-05-22T21:18:33.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba8a5688-18c9-4315-9cdb-0edace59b376 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17682025-05-22T21:18:33.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba8a5688-18c9-4315-9cdb-0edace59b376 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17692025-05-22T21:18:33.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba8a5688-18c9-4315-9cdb-0edace59b376 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17702025-05-22T21:18:34.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72fe8d3b-258e-4815-8a4c-0e71b61d1c61 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17712025-05-22T21:18:34.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72fe8d3b-258e-4815-8a4c-0e71b61d1c61 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17722025-05-22T21:18:34.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72fe8d3b-258e-4815-8a4c-0e71b61d1c61 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
17732025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
17742025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
17752025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17762025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
17772025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
17782025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
17792025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
17802025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17812025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
17822025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
17832025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17842025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
17852025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
17862025-05-22T21:18:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:08:35.085265676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
17872025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
17882025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
17892025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
17902025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
17912025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
17922025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 3 reason = Timeout
17932025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
17942025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
17952025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
17962025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
17972025-05-22T21:18:35.085ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
17982025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 15.651\u{b5}s iteration = 3 status = {"error":"no config"}
17992025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
18002025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
18012025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
18022025-05-22T21:18:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
18032025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
18042025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.98\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
18052025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
18062025-05-22T21:18:35.085ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
18072025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.96\u{b5}s iteration = 3 status = {"error":"no config"}
18082025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18092025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
18102025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
18112025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18122025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 2 reason = Timeout
18132025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
18142025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
18152025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18162025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
18172025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
18182025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18192025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
18202025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
18212025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
18222025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18232025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
18242025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18252025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
18262025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
18272025-05-22T21:18:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
18282025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
18292025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18302025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18312025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18322025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
18332025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
18342025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
18352025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
18362025-05-22T21:18:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
18372025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
18382025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
18392025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
18402025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
18412025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
18422025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
18432025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
18442025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18452025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
18462025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
18472025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
18482025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18492025-05-22T21:18:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18502025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18512025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
18522025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
18532025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
18542025-05-22T21:18:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 229673843 } })
18552025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18562025-05-22T21:18:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 229684214 } })
18572025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18582025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
18592025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
18602025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18612025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18622025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
18632025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18642025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18652025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18662025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18672025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
18682025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
18692025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
18702025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
18712025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
18722025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
18732025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18742025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 2 reason = Timeout
18752025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
18762025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
18772025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
18782025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.544013ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
18792025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
18802025-05-22T21:18:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.404991ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
18812025-05-22T21:18:35.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18822025-05-22T21:18:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18832025-05-22T21:18:35.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.979259ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
18842025-05-22T21:18:35.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.166882ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
18852025-05-22T21:18:35.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 234381533 } })
18862025-05-22T21:18:35.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
18872025-05-22T21:18:35.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18882025-05-22T21:18:35.098ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18892025-05-22T21:18:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18902025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.857891ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
18912025-05-22T21:18:35.100ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:08:35.085265676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
18922025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.189326ms iteration = 2 status = {"expiration":"2025-05-22T21:08:35.085265676Z","pruned":[]}
18932025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
18942025-05-22T21:18:35.100ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
18952025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 15.269358ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
18962025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18972025-05-22T21:18:35.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18982025-05-22T21:18:35.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 244319271 } })
18992025-05-22T21:18:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
19002025-05-22T21:18:35.101ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
19012025-05-22T21:18:35.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19022025-05-22T21:18:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19032025-05-22T21:18:35.123ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
19042025-05-22T21:18:35.123ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 36.765067ms iteration = 2 status = {"by_rx":{},"error":null}
19052025-05-22T21:18:35.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
19062025-05-22T21:18:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
19072025-05-22T21:18:35.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
19082025-05-22T21:18:35.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19092025-05-22T21:18:35.157ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "628c2bf7-fd53-4403-a973-f4452ac641c5", "content-length": "26", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
19102025-05-22T21:18:35.157ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19112025-05-22T21:18:35.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19122025-05-22T21:18:35.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
19132025-05-22T21:18:35.163ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19142025-05-22T21:18:35.164ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "244d1ada-d9df-4d6f-ac78-a353366728a9", "content-length": "26", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
19152025-05-22T21:18:35.164ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19162025-05-22T21:18:35.164ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
19172025-05-22T21:18:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
19182025-05-22T21:18:35.165ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
19192025-05-22T21:18:35.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.113667ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
19202025-05-22T21:18:35.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212025-05-22T21:18:35.173ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19222025-05-22T21:18:35.176ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19232025-05-22T21:18:35.176ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
19242025-05-22T21:18:35.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
19252025-05-22T21:18:35.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
19262025-05-22T21:18:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
19272025-05-22T21:18:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
19282025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19292025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19302025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19312025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19322025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
19332025-05-22T21:18:35.177ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
19342025-05-22T21:18:35.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
19352025-05-22T21:18:35.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
19362025-05-22T21:18:35.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
19372025-05-22T21:18:35.179ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19382025-05-22T21:18:35.180ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19392025-05-22T21:18:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
19402025-05-22T21:18:35.183ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
19412025-05-22T21:18:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
19422025-05-22T21:18:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
19432025-05-22T21:18:35.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19442025-05-22T21:18:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19452025-05-22T21:18:35.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19462025-05-22T21:18:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
19472025-05-22T21:18:35.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
19482025-05-22T21:18:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
19492025-05-22T21:18:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
19502025-05-22T21:18:35.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19512025-05-22T21:18:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19522025-05-22T21:18:35.193ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 107.865675ms iteration = 2 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
19532025-05-22T21:18:35.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19542025-05-22T21:18:35.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552025-05-22T21:18:35.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19562025-05-22T21:18:35.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19572025-05-22T21:18:35.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19582025-05-22T21:18:35.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19592025-05-22T21:18:35.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
19602025-05-22T21:18:35.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19612025-05-22T21:18:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19622025-05-22T21:18:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19632025-05-22T21:18:35.199ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 114.32103ms iteration = 3 status = {"errors":[],"requests_created_ok":[]}
19642025-05-22T21:18:35.201ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1024, tv_nsec: 345290743 } })
19652025-05-22T21:18:35.202ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
19662025-05-22T21:18:35.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19672025-05-22T21:18:35.204ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19682025-05-22T21:18:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19692025-05-22T21:18:35.206ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19702025-05-22T21:18:35.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19712025-05-22T21:18:35.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19722025-05-22T21:18:35.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19732025-05-22T21:18:35.210ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19742025-05-22T21:18:35.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
19752025-05-22T21:18:35.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19762025-05-22T21:18:35.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19772025-05-22T21:18:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19782025-05-22T21:18:35.213ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19792025-05-22T21:18:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19802025-05-22T21:18:35.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19812025-05-22T21:18:35.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19822025-05-22T21:18:35.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19832025-05-22T21:18:35.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
19842025-05-22T21:18:35.220ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
19852025-05-22T21:18:35.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
19862025-05-22T21:18:35.226ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19872025-05-22T21:18:35.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19882025-05-22T21:18:35.229ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19892025-05-22T21:18:35.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19902025-05-22T21:18:35.231ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
19912025-05-22T21:18:35.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
19922025-05-22T21:18:35.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19932025-05-22T21:18:35.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
19942025-05-22T21:18:35.240ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
19952025-05-22T21:18:35.240ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 154.575129ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
19962025-05-22T21:18:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
19972025-05-22T21:18:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19982025-05-22T21:18:35.246ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19992025-05-22T21:18:35.246ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
20002025-05-22T21:18:35.246ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
20012025-05-22T21:18:35.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 161.117357ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20022025-05-22T21:18:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
20032025-05-22T21:18:35.247ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
20042025-05-22T21:18:35.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 162.600669ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
20052025-05-22T21:18:35.248ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
20062025-05-22T21:18:35.248ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
20072025-05-22T21:18:35.248ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 162.830202ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
20082025-05-22T21:18:35.250ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20092025-05-22T21:18:35.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20102025-05-22T21:18:35.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 166.745151ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
20112025-05-22T21:18:35.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 167.284648ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
20122025-05-22T21:18:35.252ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20132025-05-22T21:18:35.255ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
20142025-05-22T21:18:35.255ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
20152025-05-22T21:18:35.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
20162025-05-22T21:18:35.262ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20172025-05-22T21:18:35.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20182025-05-22T21:18:35.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20192025-05-22T21:18:35.269ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20202025-05-22T21:18:35.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20212025-05-22T21:18:35.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20222025-05-22T21:18:35.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20232025-05-22T21:18:35.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
20242025-05-22T21:18:35.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
20252025-05-22T21:18:35.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
20262025-05-22T21:18:35.284ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
20272025-05-22T21:18:35.284ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
20282025-05-22T21:18:35.284ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
20292025-05-22T21:18:35.284ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20302025-05-22T21:18:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20312025-05-22T21:18:35.286ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20322025-05-22T21:18:35.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20332025-05-22T21:18:35.288ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20342025-05-22T21:18:35.288ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 203.103342ms iteration = 5 status = {"physical_disks_added":0}
20352025-05-22T21:18:35.288ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20362025-05-22T21:18:35.291ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
20372025-05-22T21:18:35.291ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
20382025-05-22T21:18:35.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
20392025-05-22T21:18:35.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 208.38321ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
20402025-05-22T21:18:35.294ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20412025-05-22T21:18:35.294ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20422025-05-22T21:18:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20432025-05-22T21:18:35.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
20442025-05-22T21:18:35.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
20452025-05-22T21:18:35.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
20462025-05-22T21:18:35.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20472025-05-22T21:18:35.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20482025-05-22T21:18:35.297ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
20492025-05-22T21:18:35.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
20502025-05-22T21:18:35.298ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20512025-05-22T21:18:35.301ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
20522025-05-22T21:18:35.301ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 215.77667ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
20532025-05-22T21:18:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20542025-05-22T21:18:35.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20552025-05-22T21:18:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20562025-05-22T21:18:35.304ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
20572025-05-22T21:18:35.304ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
20582025-05-22T21:18:35.304ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 218.970978ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
20592025-05-22T21:18:35.308ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
20602025-05-22T21:18:35.308ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
20612025-05-22T21:18:35.308ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cb6194f-d6d5-4a98-b657-a991983964de", "content-length": "26", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
20622025-05-22T21:18:35.308ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
20632025-05-22T21:18:35.309ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
20642025-05-22T21:18:35.328ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
20652025-05-22T21:18:35.328ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
20662025-05-22T21:18:35.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20672025-05-22T21:18:35.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20682025-05-22T21:18:35.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20692025-05-22T21:18:35.331ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 245.868188ms iteration = 3 status = {}
20702025-05-22T21:18:35.334ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
20712025-05-22T21:18:35.334ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
20722025-05-22T21:18:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
20732025-05-22T21:18:35.337ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
20742025-05-22T21:18:35.337ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
20752025-05-22T21:18:35.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20762025-05-22T21:18:35.338ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
20772025-05-22T21:18:35.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20782025-05-22T21:18:35.339ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
20792025-05-22T21:18:35.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
20802025-05-22T21:18:35.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
20812025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
20822025-05-22T21:18:35.342ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
20832025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 257.040844ms iteration = 2 status = {"generation":1}
20842025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
20852025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
20862025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
20872025-05-22T21:18:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
20882025-05-22T21:18:35.346ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
20892025-05-22T21:18:35.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
20902025-05-22T21:18:35.354ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
20912025-05-22T21:18:35.354ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 268.986872ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
20922025-05-22T21:18:35.410ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
20932025-05-22T21:18:35.410ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 324.903164ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
20942025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
20952025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
20962025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
20972025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
20982025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
20992025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
21002025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
21012025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
21022025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
21032025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
21042025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
21052025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
21062025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles versions = all
21072025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/system/support-bundles versions = all
21082025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
21092025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
21102025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
21112025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
21122025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
21132025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
21142025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
21152025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
21162025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
21172025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
21182025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
21192025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
21202025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
21212025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
21222025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
21232025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
21242025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
21252025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
21262025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
21272025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups versions = all
21282025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/affinity-groups versions = all
21292025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
21302025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
21312025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
21322025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
21332025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21342025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21352025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
21362025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups versions = all
21372025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/anti-affinity-groups versions = all
21382025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21392025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21402025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
21412025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
21422025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
21432025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
21442025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
21452025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
21462025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
21472025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
21482025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
21492025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
21502025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
21512025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
21522025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
21532025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
21542025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
21552025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
21562025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
21572025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
21582025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
21592025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
21602025-05-22T21:18:35.410ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
21612025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
21622025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
21632025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
21642025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
21652025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
21662025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
21672025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
21682025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
21692025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
21702025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
21712025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
21722025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
21732025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
21742025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
21752025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
21762025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
21772025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
21782025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
21792025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
21802025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
21812025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
21822025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
21832025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
21842025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21852025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
21862025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
21872025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
21882025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
21892025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
21902025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
21912025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
21922025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
21932025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
21942025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
21952025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
21962025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
21972025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
21982025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
21992025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
22002025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
22012025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
22022025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
22032025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
22042025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
22052025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
22062025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
22072025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
22082025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
22092025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
22102025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
22112025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
22122025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
22132025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
22142025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
22152025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
22162025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
22172025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
22182025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
22192025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
22202025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
22212025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
22222025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
22232025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
22242025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
22252025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
22262025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
22272025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
22282025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
22292025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
22302025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
22312025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
22322025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
22332025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
22342025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
22352025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
22362025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
22372025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
22382025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
22392025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
22402025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
22412025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
22422025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
22432025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
22442025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
22452025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
22462025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
22472025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
22482025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
22492025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
22502025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
22512025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
22522025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
22532025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
22542025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
22552025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
22562025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
22572025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
22582025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
22592025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
22602025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
22612025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
22622025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
22632025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
22642025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
22652025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
22662025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
22672025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
22682025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22692025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
22702025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
22712025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
22722025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
22732025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
22742025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
22752025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
22762025-05-22T21:18:35.411ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
22772025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
22782025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
22792025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
22802025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
22812025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
22822025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
22832025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
22842025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
22852025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
22862025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
22872025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
22882025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
22892025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
22902025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
22912025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
22922025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
22932025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
22942025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
22952025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
22962025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
22972025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
22982025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
22992025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
23002025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
23012025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
23022025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
23032025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
23042025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
23052025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
23062025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
23072025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
23082025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
23092025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
23102025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
23112025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
23122025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
23132025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
23142025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
23152025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
23162025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
23172025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
23182025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
23192025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
23202025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
23212025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/target-release versions = all
23222025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/target-release versions = all
23232025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
23242025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
23252025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
23262025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
23272025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
23282025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
23292025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query versions = all
23302025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
23312025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
23322025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
23332025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
23342025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
23352025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
23362025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
23372025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
23382025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
23392025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
23402025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
23412025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
23422025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
23432025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
23442025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
23452025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
23462025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
23472025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
23482025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
23492025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
23502025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
23512025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
23522025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
23532025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
23542025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
23552025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/webhooks/deliveries versions = all
23562025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/webhooks/deliveries/{event_id}/resend versions = all
23572025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/webhooks/event-classes versions = all
23582025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/webhooks/receivers versions = all
23592025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/webhooks/receivers versions = all
23602025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/webhooks/receivers/{receiver} versions = all
23612025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/webhooks/receivers/{receiver} versions = all
23622025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/webhooks/receivers/{receiver} versions = all
23632025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/webhooks/receivers/{receiver}/probe versions = all
23642025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/webhooks/receivers/{receiver}/subscriptions versions = all
23652025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/webhooks/receivers/{receiver}/subscriptions/{subscription} versions = all
23662025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/webhooks/secrets versions = all
23672025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/webhooks/secrets versions = all
23682025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/webhooks/secrets/{secret_id} versions = all
23692025-05-22T21:18:35.412ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:328 local_addr = 172.30.2.6:443
23702025-05-22T21:18:35.412ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
23712025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
23722025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
23732025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
23742025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
23752025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
23762025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
23772025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
23782025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
23792025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
23802025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
23812025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
23822025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
23832025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
23842025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
23852025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
23862025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{bundle_id} versions = all
23872025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
23882025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download versions = all
23892025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
23902025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{bundle_id}/download/{file} versions = all
23912025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{bundle_id}/index versions = all
23922025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
23932025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
23942025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
23952025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
23962025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
23972025-05-22T21:18:35.419ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
23982025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
23992025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
24002025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
24012025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
24022025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
24032025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
24042025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups versions = all
24052025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/affinity-groups versions = all
24062025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
24072025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
24082025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
24092025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
24102025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24112025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24122025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
24132025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups versions = all
24142025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/anti-affinity-groups versions = all
24152025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24162025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24172025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
24182025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
24192025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24202025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24212025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
24222025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
24232025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
24242025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
24252025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
24262025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
24272025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
24282025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
24292025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
24302025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
24312025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
24322025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
24332025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
24342025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
24352025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
24362025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
24372025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
24382025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
24392025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
24402025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
24412025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
24422025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
24432025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
24442025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
24452025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
24462025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
24472025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
24482025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
24492025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
24502025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
24512025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
24522025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
24532025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
24542025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
24552025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/affinity-groups versions = all
24562025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/anti-affinity-groups versions = all
24572025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
24582025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
24592025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
24602025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
24612025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24622025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
24632025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
24642025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
24652025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
24662025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
24672025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
24682025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
24692025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
24702025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
24712025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
24722025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
24732025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
24742025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
24752025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
24762025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
24772025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
24782025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
24792025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
24802025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
24812025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
24822025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
24832025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
24842025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
24852025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
24862025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
24872025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
24882025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
24892025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
24902025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
24912025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
24922025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
24932025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
24942025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
24952025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
24962025-05-22T21:18:35.420ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
24972025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
24982025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
24992025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
25002025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
25012025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
25022025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
25032025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
25042025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
25052025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
25062025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
25072025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
25082025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
25092025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
25102025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
25112025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
25122025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
25132025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
25142025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
25152025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
25162025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
25172025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
25182025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
25192025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
25202025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
25212025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
25222025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
25232025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
25242025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
25252025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
25262025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
25272025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
25282025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
25292025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
25302025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
25312025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
25322025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
25332025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
25342025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
25352025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
25362025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
25372025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
25382025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
25392025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
25402025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
25412025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
25422025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
25432025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
25442025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
25452025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
25462025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
25472025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
25482025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
25492025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
25502025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
25512025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
25522025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
25532025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
25542025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
25552025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
25562025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
25572025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
25582025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
25592025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
25602025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
25612025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
25622025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
25632025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
25642025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
25652025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
25662025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
25672025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
25682025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
25692025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
25702025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
25712025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
25722025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
25732025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
25742025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
25752025-05-22T21:18:35.421ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
25762025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
25772025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
25782025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
25792025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
25802025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
25812025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
25822025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
25832025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
25842025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
25852025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
25862025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
25872025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
25882025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
25892025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
25902025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
25912025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
25922025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
25932025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
25942025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
25952025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
25962025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
25972025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
25982025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/target-release versions = all
25992025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/target-release versions = all
26002025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
26012025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
26022025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
26032025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
26042025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
26052025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
26062025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query versions = all
26072025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
26082025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
26092025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
26102025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
26112025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
26122025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
26132025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
26142025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
26152025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
26162025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
26172025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
26182025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
26192025-05-22T21:18:35.423ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
26202025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
26212025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
26222025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
26232025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
26242025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
26252025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
26262025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
26272025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
26282025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
26292025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
26302025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
26312025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
26322025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/webhooks/deliveries versions = all
26332025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/webhooks/deliveries/{event_id}/resend versions = all
26342025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/webhooks/event-classes versions = all
26352025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/webhooks/receivers versions = all
26362025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/webhooks/receivers versions = all
26372025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/webhooks/receivers/{receiver} versions = all
26382025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/webhooks/receivers/{receiver} versions = all
26392025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/webhooks/receivers/{receiver} versions = all
26402025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/webhooks/receivers/{receiver}/probe versions = all
26412025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/webhooks/receivers/{receiver}/subscriptions versions = all
26422025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/webhooks/receivers/{receiver}/subscriptions/{subscription} versions = all
26432025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/webhooks/secrets versions = all
26442025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/webhooks/secrets versions = all
26452025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/webhooks/secrets/{secret_id} versions = all
26462025-05-22T21:18:35.424ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:12228
26472025-05-22T21:18:35.424ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
26482025-05-22T21:18:35.426ZDEBGnexus (nexus-producer-server): registered DTrace probes
26492025-05-22T21:18:35.430ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:55772 method = GET path = /{producer_id} versions = all
26502025-05-22T21:18:35.430ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:55772
26512025-05-22T21:18:35.430ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:55772
26522025-05-22T21:18:35.430ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:55772
26532025-05-22T21:18:35.430ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
26542025-05-22T21:18:35.430ZDEBGnexus (nexus-producer-server): starting producer registration task
26552025-05-22T21:18:35.431ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:55772 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
26562025-05-22T21:18:35.431ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 0
26572025-05-22T21:18:35.431ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
26582025-05-22T21:18:35.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ab30a2b-ebd0-4453-a5cb-cd0bf487083a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
26592025-05-22T21:18:35.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ab30a2b-ebd0-4453-a5cb-cd0bf487083a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
26602025-05-22T21:18:35.505ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
26612025-05-22T21:18:35.505ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26622025-05-22T21:18:35.506ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f096b66-620b-4034-a3cc-0d840533877c", "content-length": "372", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
26632025-05-22T21:18:35.506ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26642025-05-22T21:18:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26652025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
26662025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
26672025-05-22T21:18:35.508ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
26682025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 423.068316ms iteration = 2 status = {"generation":2}
26692025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
26702025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
26712025-05-22T21:18:35.508ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26722025-05-22T21:18:35.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 51578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ab30a2b-ebd0-4453-a5cb-cd0bf487083a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
26732025-05-22T21:18:35.509ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6df4f938-a2fc-4a46-93dc-d1b205baadb0", "content-length": "691", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
26742025-05-22T21:18:35.509ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
26752025-05-22T21:18:35.509ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
26762025-05-22T21:18:35.509ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
26772025-05-22T21:18:35.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26782025-05-22T21:18:35.509ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 423.653914ms iteration = 3 status = null
26792025-05-22T21:18:35.510ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 424.625129ms iteration = 3 status = {}
26802025-05-22T21:18:35.510ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26812025-05-22T21:18:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
26822025-05-22T21:18:35.513ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
26832025-05-22T21:18:35.513ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
26842025-05-22T21:18:35.515ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 430.296813ms iteration = 3 status = 0
26852025-05-22T21:18:35.629ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
26862025-05-22T21:18:35.659ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
26872025-05-22T21:18:35.659ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
26882025-05-22T21:18:35.659ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3bb31126-6a35-4e3e-a1ca-6ec2b1b1e0d1", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
26892025-05-22T21:18:35.659ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26902025-05-22T21:18:35.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26912025-05-22T21:18:35.662ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26922025-05-22T21:18:35.662ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26932025-05-22T21:18:35.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
26942025-05-22T21:18:35.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
26952025-05-22T21:18:35.669ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
26962025-05-22T21:18:35.669ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
26972025-05-22T21:18:35.669ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "40872fc3-b0ff-4b80-befa-1e0891eb89d9", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
26982025-05-22T21:18:35.671ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 585.570753ms iteration = 3 status = {}
26992025-05-22T21:18:35.698ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
27002025-05-22T21:18:35.698ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:45537
27012025-05-22T21:18:35.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45537 req_id = 0c2b9286-f73d-4004-89fb-3d381e5e64a0 roles = RoleSet { roles: {} } uri = /metrics/producers
27022025-05-22T21:18:35.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45537 req_id = 0c2b9286-f73d-4004-89fb-3d381e5e64a0 resource = Database result = Ok(()) uri = /metrics/producers
27032025-05-22T21:18:35.742ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
27042025-05-22T21:18:35.744ZINFOnexus: assigned collector to new producer collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 file = nexus/src/app/oximeter.rs:76 producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
27052025-05-22T21:18:35.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 46238 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:45537 req_id = 0c2b9286-f73d-4004-89fb-3d381e5e64a0 response_code = 201 uri = /metrics/producers
27062025-05-22T21:18:35.744ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "0c2b9286-f73d-4004-89fb-3d381e5e64a0", "content-length": "41", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
27072025-05-22T21:18:35.746ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
27082025-05-22T21:18:35.778ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27092025-05-22T21:18:35.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27102025-05-22T21:18:35.784ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
27112025-05-22T21:18:35.784ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27122025-05-22T21:18:35.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27132025-05-22T21:18:35.830ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
27142025-05-22T21:18:35.888ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
27152025-05-22T21:18:35.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d1a8d583-d644-404b-bb29-45cd917717e4", "date": "Thu, 22 May 2025 21:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27162025-05-22T21:18:35.893ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27172025-05-22T21:18:35.894ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "96974497-5415-42d8-ac60-26b6fd378c1c", "date": "Thu, 22 May 2025 21:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27182025-05-22T21:18:35.894ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27192025-05-22T21:18:35.895ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
27202025-05-22T21:18:35.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 387.03826ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
27212025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
27222025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
27232025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
27242025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
27252025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27262025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27272025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27282025-05-22T21:18:35.900ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27292025-05-22T21:18:35.901ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
27302025-05-22T21:18:35.901ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
27312025-05-22T21:18:35.901ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
27322025-05-22T21:18:35.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27332025-05-22T21:18:35.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27342025-05-22T21:18:35.907ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
27352025-05-22T21:18:35.908ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6197f095-4493-471d-a5f1-ccba3096a06a", "date": "Thu, 22 May 2025 21:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27362025-05-22T21:18:35.908ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27372025-05-22T21:18:35.909ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
27382025-05-22T21:18:35.909ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
27392025-05-22T21:18:35.909ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b2baec2c-a405-4391-85c0-9e8f80e5d9dd", "date": "Thu, 22 May 2025 21:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27402025-05-22T21:18:35.909ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27412025-05-22T21:18:35.911ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d05cbaf0-699e-4bca-af6f-16f6727767ba", "date": "Thu, 22 May 2025 21:18:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27422025-05-22T21:18:35.911ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27432025-05-22T21:18:35.913ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
27442025-05-22T21:18:35.913ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 570.988018ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
27452025-05-22T21:18:36.009ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "a7a3c911-2aed-49b2-88b3-67debbeaccd9", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
27462025-05-22T21:18:36.009ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
27472025-05-22T21:18:36.009ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
27482025-05-22T21:18:36.009ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "34548847-6cc1-4ea0-87d6-e3666cb8431d", "content-length": "682", "date": "Thu, 22 May 2025 21:18:35 GMT"} })
27492025-05-22T21:18:36.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27502025-05-22T21:18:36.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27512025-05-22T21:18:36.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27522025-05-22T21:18:36.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27532025-05-22T21:18:36.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27542025-05-22T21:18:36.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27552025-05-22T21:18:36.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27562025-05-22T21:18:36.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27572025-05-22T21:18:36.028ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 942.989292ms iteration = 3 status = {}
27582025-05-22T21:18:36.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a0d8c22-e897-489d-9b9e-bb11cbc52f22 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27592025-05-22T21:18:36.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a0d8c22-e897-489d-9b9e-bb11cbc52f22 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27602025-05-22T21:18:36.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a0d8c22-e897-489d-9b9e-bb11cbc52f22 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27612025-05-22T21:18:37.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e99b78bc-6338-42ca-858e-977397231f2b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27622025-05-22T21:18:37.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e99b78bc-6338-42ca-858e-977397231f2b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27632025-05-22T21:18:37.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e99b78bc-6338-42ca-858e-977397231f2b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27642025-05-22T21:18:38.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2706e56c-9b60-47cf-8323-35091a3b5397 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27652025-05-22T21:18:38.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2706e56c-9b60-47cf-8323-35091a3b5397 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27662025-05-22T21:18:38.558ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2706e56c-9b60-47cf-8323-35091a3b5397 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27672025-05-22T21:18:39.573ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f4e616b-7aaa-4819-af0b-68e2270f58fa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27682025-05-22T21:18:39.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f4e616b-7aaa-4819-af0b-68e2270f58fa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27692025-05-22T21:18:39.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 110167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f4e616b-7aaa-4819-af0b-68e2270f58fa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27702025-05-22T21:18:40.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b92c2a5f-b0d4-48e5-90ba-74b517c7ba8c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27712025-05-22T21:18:40.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b92c2a5f-b0d4-48e5-90ba-74b517c7ba8c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27722025-05-22T21:18:40.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b92c2a5f-b0d4-48e5-90ba-74b517c7ba8c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27732025-05-22T21:18:41.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a98c0d31-c17d-40a8-8369-478c07e16329 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27742025-05-22T21:18:41.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a98c0d31-c17d-40a8-8369-478c07e16329 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27752025-05-22T21:18:41.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a98c0d31-c17d-40a8-8369-478c07e16329 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27762025-05-22T21:18:42.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68e9abbe-6c4d-4f7a-b0b1-71da86e95094 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27772025-05-22T21:18:42.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68e9abbe-6c4d-4f7a-b0b1-71da86e95094 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27782025-05-22T21:18:42.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2209 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68e9abbe-6c4d-4f7a-b0b1-71da86e95094 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27792025-05-22T21:18:43.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adc78b73-ce50-4fc6-bb35-b98334b2f91c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27802025-05-22T21:18:43.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adc78b73-ce50-4fc6-bb35-b98334b2f91c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27812025-05-22T21:18:43.748ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adc78b73-ce50-4fc6-bb35-b98334b2f91c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27822025-05-22T21:18:44.763ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ef83c7b-dd72-42c7-92f5-eafca080933f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27832025-05-22T21:18:44.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ef83c7b-dd72-42c7-92f5-eafca080933f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27842025-05-22T21:18:44.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ef83c7b-dd72-42c7-92f5-eafca080933f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
27852025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
27862025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27872025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
27882025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27892025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27902025-05-22T21:18:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27912025-05-22T21:18:45.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27922025-05-22T21:18:45.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27932025-05-22T21:18:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27942025-05-22T21:18:45.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.869747ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
27952025-05-22T21:18:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27962025-05-22T21:18:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27972025-05-22T21:18:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27982025-05-22T21:18:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27992025-05-22T21:18:45.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28002025-05-22T21:18:45.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28012025-05-22T21:18:45.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
28022025-05-22T21:18:45.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28032025-05-22T21:18:45.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28042025-05-22T21:18:45.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
28052025-05-22T21:18:45.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.416864ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
28062025-05-22T21:18:45.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d461aefb-1ba6-48cd-83cb-ac89bce2d7fc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28072025-05-22T21:18:45.779ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d461aefb-1ba6-48cd-83cb-ac89bce2d7fc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28082025-05-22T21:18:45.781ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d461aefb-1ba6-48cd-83cb-ac89bce2d7fc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28092025-05-22T21:18:46.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 918e657b-00f5-49aa-ab21-4543bb088999 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28102025-05-22T21:18:46.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 918e657b-00f5-49aa-ab21-4543bb088999 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28112025-05-22T21:18:46.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 918e657b-00f5-49aa-ab21-4543bb088999 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28122025-05-22T21:18:47.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 57dd5eba-0585-4601-8158-4c3bef1200be roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28132025-05-22T21:18:47.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 57dd5eba-0585-4601-8158-4c3bef1200be resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28142025-05-22T21:18:47.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2619 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 57dd5eba-0585-4601-8158-4c3bef1200be response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28152025-05-22T21:18:48.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 19eccb44-c630-469a-b638-28a4cdc76164 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
28162025-05-22T21:18:48.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 19eccb44-c630-469a-b638-28a4cdc76164 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
28172025-05-22T21:18:48.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 19eccb44-c630-469a-b638-28a4cdc76164 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
28182025-05-22T21:18:48.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 51ce7d2a-ed81-4ec1-9a89-5ca154439fb1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZGZlMjc4Ni1iMmNlLTRlZTEtOTU1Zi1kNDU1MjNjZjU2MTEifX0%3D
28192025-05-22T21:18:48.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 51ce7d2a-ed81-4ec1-9a89-5ca154439fb1 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZGZlMjc4Ni1iMmNlLTRlZTEtOTU1Zi1kNDU1MjNjZjU2MTEifX0%3D
28202025-05-22T21:18:48.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:35416 req_id = 51ce7d2a-ed81-4ec1-9a89-5ca154439fb1 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI2ZGZlMjc4Ni1iMmNlLTRlZTEtOTU1Zi1kNDU1MjNjZjU2MTEifX0%3D
28212025-05-22T21:18:48.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 39836908-eb10-4bb0-857b-9603a831130c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28222025-05-22T21:18:48.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 39836908-eb10-4bb0-857b-9603a831130c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28232025-05-22T21:18:48.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 39836908-eb10-4bb0-857b-9603a831130c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28242025-05-22T21:18:49.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fca3cdee-9ded-4f98-97ca-525d0f38ffda roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28252025-05-22T21:18:49.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fca3cdee-9ded-4f98-97ca-525d0f38ffda resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28262025-05-22T21:18:49.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fca3cdee-9ded-4f98-97ca-525d0f38ffda response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28272025-05-22T21:18:50.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6e08700-6393-4b04-85cf-ee8860120646 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28282025-05-22T21:18:50.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6e08700-6393-4b04-85cf-ee8860120646 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28292025-05-22T21:18:50.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6e08700-6393-4b04-85cf-ee8860120646 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28302025-05-22T21:18:51.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7079fa82-bf74-4fbf-8772-12da76045310 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28312025-05-22T21:18:51.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7079fa82-bf74-4fbf-8772-12da76045310 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28322025-05-22T21:18:51.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7079fa82-bf74-4fbf-8772-12da76045310 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28332025-05-22T21:18:52.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81e596ee-a27b-4296-be04-22fc896a7c78 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28342025-05-22T21:18:52.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81e596ee-a27b-4296-be04-22fc896a7c78 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28352025-05-22T21:18:52.900ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81e596ee-a27b-4296-be04-22fc896a7c78 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28362025-05-22T21:18:53.914ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ae56935-8230-48ec-8ed1-7e56a43b1dc9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28372025-05-22T21:18:53.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ae56935-8230-48ec-8ed1-7e56a43b1dc9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28382025-05-22T21:18:53.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ae56935-8230-48ec-8ed1-7e56a43b1dc9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28392025-05-22T21:18:54.930ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36f500cf-1584-4621-b91b-47b9a9b40cc2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28402025-05-22T21:18:54.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36f500cf-1584-4621-b91b-47b9a9b40cc2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28412025-05-22T21:18:54.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36f500cf-1584-4621-b91b-47b9a9b40cc2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28422025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
28432025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
28442025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28452025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28462025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28472025-05-22T21:18:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28482025-05-22T21:18:55.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28492025-05-22T21:18:55.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28502025-05-22T21:18:55.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28512025-05-22T21:18:55.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.101191ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28522025-05-22T21:18:55.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
28532025-05-22T21:18:55.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28542025-05-22T21:18:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28552025-05-22T21:18:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28562025-05-22T21:18:55.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28572025-05-22T21:18:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582025-05-22T21:18:55.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
28592025-05-22T21:18:55.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28602025-05-22T21:18:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28612025-05-22T21:18:55.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
28622025-05-22T21:18:55.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.819164ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
28632025-05-22T21:18:55.946ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24fac0ee-e7a8-4239-9f9c-a8dccef4ff95 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28642025-05-22T21:18:55.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24fac0ee-e7a8-4239-9f9c-a8dccef4ff95 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28652025-05-22T21:18:55.948ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24fac0ee-e7a8-4239-9f9c-a8dccef4ff95 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28662025-05-22T21:18:56.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8d22375-ed89-4c9b-8738-7a6dea2fcdc1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28672025-05-22T21:18:56.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8d22375-ed89-4c9b-8738-7a6dea2fcdc1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28682025-05-22T21:18:56.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8d22375-ed89-4c9b-8738-7a6dea2fcdc1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28692025-05-22T21:18:57.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95cfa25b-525a-4817-a23e-580d60e7e4b1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28702025-05-22T21:18:57.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95cfa25b-525a-4817-a23e-580d60e7e4b1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28712025-05-22T21:18:57.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95cfa25b-525a-4817-a23e-580d60e7e4b1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28722025-05-22T21:18:58.158ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:55772 remote_addr = [fd00:1122:3344:101::d]:53420
28732025-05-22T21:18:58.171ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 13051 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 5c96f571-69e7-4a02-baae-9e5b8bf1e542 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
28742025-05-22T21:18:58.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31170859-7ead-4479-a7ab-18caf25be117 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28752025-05-22T21:18:58.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31170859-7ead-4479-a7ab-18caf25be117 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28762025-05-22T21:18:58.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2590 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31170859-7ead-4479-a7ab-18caf25be117 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28772025-05-22T21:19:00.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 489d3599-6ee6-49ab-a93c-e1f60526666c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28782025-05-22T21:19:00.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 489d3599-6ee6-49ab-a93c-e1f60526666c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28792025-05-22T21:19:00.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 489d3599-6ee6-49ab-a93c-e1f60526666c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28802025-05-22T21:19:01.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07bde6e9-6e03-419c-95d3-77e9375c6bcd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28812025-05-22T21:19:01.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07bde6e9-6e03-419c-95d3-77e9375c6bcd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28822025-05-22T21:19:01.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07bde6e9-6e03-419c-95d3-77e9375c6bcd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28832025-05-22T21:19:02.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 326b39c3-1ba3-467a-bd27-6e272a404ccb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28842025-05-22T21:19:02.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 326b39c3-1ba3-467a-bd27-6e272a404ccb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28852025-05-22T21:19:02.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 326b39c3-1ba3-467a-bd27-6e272a404ccb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28862025-05-22T21:19:03.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03543dd4-bcd2-463a-af78-ad9e7631b832 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28872025-05-22T21:19:03.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03543dd4-bcd2-463a-af78-ad9e7631b832 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28882025-05-22T21:19:03.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03543dd4-bcd2-463a-af78-ad9e7631b832 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28892025-05-22T21:19:04.074ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e181677-2961-49b5-b120-e06243d9fc16 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28902025-05-22T21:19:04.074ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e181677-2961-49b5-b120-e06243d9fc16 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28912025-05-22T21:19:04.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e181677-2961-49b5-b120-e06243d9fc16 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
28922025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
28932025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
28942025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28952025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28962025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
28972025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28982025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
28992025-05-22T21:19:05.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
29002025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
29012025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29022025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29032025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
29042025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
29052025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
29062025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29072025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
29082025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
29092025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
29102025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
29112025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29122025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 4 reason = Timeout
29132025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
29142025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
29152025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
29162025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29172025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
29182025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
29192025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
29202025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
29212025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
29222025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
29232025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
29242025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
29252025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
29262025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29272025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
29282025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29292025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
29302025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29312025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29322025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
29332025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29342025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
29352025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
29362025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29372025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29382025-05-22T21:19:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
29392025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29402025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
29412025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29422025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29432025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
29442025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
29452025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29462025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29472025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
29482025-05-22T21:19:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
29492025-05-22T21:19:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
29502025-05-22T21:19:05.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
29512025-05-22T21:19:05.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29522025-05-22T21:19:05.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.231623ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
29532025-05-22T21:19:05.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29542025-05-22T21:19:05.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6702686b-dcbf-4148-b973-c1e9a80676ee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
29552025-05-22T21:19:05.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29562025-05-22T21:19:05.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6702686b-dcbf-4148-b973-c1e9a80676ee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
29572025-05-22T21:19:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
29582025-05-22T21:19:05.091ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29592025-05-22T21:19:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29602025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29612025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29622025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29632025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29642025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
29652025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29662025-05-22T21:19:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29672025-05-22T21:19:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
29682025-05-22T21:19:05.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
29692025-05-22T21:19:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
29702025-05-22T21:19:05.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 240672652 } })
29712025-05-22T21:19:05.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29722025-05-22T21:19:05.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
29732025-05-22T21:19:05.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29742025-05-22T21:19:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
29752025-05-22T21:19:05.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29762025-05-22T21:19:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29772025-05-22T21:19:05.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
29782025-05-22T21:19:05.103ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29792025-05-22T21:19:05.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29802025-05-22T21:19:05.104ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 247579485 } })
29812025-05-22T21:19:05.104ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
29822025-05-22T21:19:05.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 15199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6702686b-dcbf-4148-b973-c1e9a80676ee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
29832025-05-22T21:19:05.106ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29842025-05-22T21:19:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
29852025-05-22T21:19:05.109ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
29862025-05-22T21:19:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
29872025-05-22T21:19:05.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29882025-05-22T21:19:05.112ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1054, tv_nsec: 255507603 } })
29892025-05-22T21:19:05.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
29902025-05-22T21:19:05.112ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
29912025-05-22T21:19:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
29922025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
29932025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29942025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
29952025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29962025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29972025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
29982025-05-22T21:19:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29992025-05-22T21:19:05.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30002025-05-22T21:19:05.115ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30012025-05-22T21:19:05.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30022025-05-22T21:19:05.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
30032025-05-22T21:19:05.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30042025-05-22T21:19:05.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30052025-05-22T21:19:05.141ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
30062025-05-22T21:19:05.141ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.309318ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
30072025-05-22T21:19:05.147ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30082025-05-22T21:19:05.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30092025-05-22T21:19:05.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30102025-05-22T21:19:05.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30112025-05-22T21:19:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.177595ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
30122025-05-22T21:19:05.159ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30132025-05-22T21:19:05.159ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
30142025-05-22T21:19:05.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30152025-05-22T21:19:05.159ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 73.749808ms iteration = 4 status = {"errors":[],"requests_created_ok":[]}
30162025-05-22T21:19:05.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30172025-05-22T21:19:05.160ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
30182025-05-22T21:19:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
30192025-05-22T21:19:05.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.532754ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
30202025-05-22T21:19:05.162ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
30212025-05-22T21:19:05.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.435383ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30222025-05-22T21:19:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
30232025-05-22T21:19:05.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30242025-05-22T21:19:05.169ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
30252025-05-22T21:19:05.169ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 83.814897ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
30262025-05-22T21:19:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
30272025-05-22T21:19:05.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
30282025-05-22T21:19:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
30292025-05-22T21:19:05.171ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30302025-05-22T21:19:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
30312025-05-22T21:19:05.174ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
30322025-05-22T21:19:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
30332025-05-22T21:19:05.198ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
30342025-05-22T21:19:05.198ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30352025-05-22T21:19:05.199ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1de22578-7f98-4b08-adc8-c49461b5848b", "content-length": "26", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30362025-05-22T21:19:05.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30372025-05-22T21:19:05.200ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
30382025-05-22T21:19:05.200ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30392025-05-22T21:19:05.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30402025-05-22T21:19:05.201ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47d0bc08-b9c2-4555-b544-1090e9b5d1b0", "content-length": "26", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30412025-05-22T21:19:05.201ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30422025-05-22T21:19:05.202ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
30432025-05-22T21:19:05.220ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
30442025-05-22T21:19:05.220ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30452025-05-22T21:19:05.221ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c804646a-99ad-4af2-9a26-00522ad8413f", "content-length": "372", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30462025-05-22T21:19:05.221ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30472025-05-22T21:19:05.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30482025-05-22T21:19:05.224ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30492025-05-22T21:19:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30502025-05-22T21:19:05.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.180181ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30512025-05-22T21:19:05.225ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
30522025-05-22T21:19:05.225ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 140.162855ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
30532025-05-22T21:19:05.226ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
30542025-05-22T21:19:05.226ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
30552025-05-22T21:19:05.226ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9319c715-f5e4-4981-94fa-c33340528e7d", "content-length": "26", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30562025-05-22T21:19:05.226ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
30572025-05-22T21:19:05.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30582025-05-22T21:19:05.228ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
30592025-05-22T21:19:05.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
30602025-05-22T21:19:05.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
30612025-05-22T21:19:05.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
30622025-05-22T21:19:05.231ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.314647ms iteration = 4 status = 0
30632025-05-22T21:19:05.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30642025-05-22T21:19:05.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30652025-05-22T21:19:05.261ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.821405ms iteration = 6 status = {"physical_disks_added":0}
30662025-05-22T21:19:05.261ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30672025-05-22T21:19:05.261ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
30682025-05-22T21:19:05.261ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
30692025-05-22T21:19:05.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
30702025-05-22T21:19:05.262ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 176.887752ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
30712025-05-22T21:19:05.264ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
30722025-05-22T21:19:05.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
30732025-05-22T21:19:05.277ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
30742025-05-22T21:19:05.277ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
30752025-05-22T21:19:05.277ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "baabd22f-69c6-452e-8c6f-5d73d5fcafc9", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30762025-05-22T21:19:05.277ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30772025-05-22T21:19:05.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30782025-05-22T21:19:05.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30792025-05-22T21:19:05.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30802025-05-22T21:19:05.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
30812025-05-22T21:19:05.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
30822025-05-22T21:19:05.284ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
30832025-05-22T21:19:05.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
30842025-05-22T21:19:05.284ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 199.02981ms iteration = 4 status = {}
30852025-05-22T21:19:05.286ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 200.874088ms iteration = 4 status = null
30862025-05-22T21:19:05.286ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
30872025-05-22T21:19:05.286ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
30882025-05-22T21:19:05.287ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "858ced43-823c-4774-94e3-16a8ab5e9cce", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
30892025-05-22T21:19:05.288ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 202.963299ms iteration = 4 status = {}
30902025-05-22T21:19:05.303ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
30912025-05-22T21:19:05.303ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
30922025-05-22T21:19:05.303ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 217.800761ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
30932025-05-22T21:19:05.305ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.205766ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
30942025-05-22T21:19:05.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
30952025-05-22T21:19:05.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
30962025-05-22T21:19:05.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
30972025-05-22T21:19:05.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
30982025-05-22T21:19:05.360ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
30992025-05-22T21:19:05.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31002025-05-22T21:19:05.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31012025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
31022025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
31032025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
31042025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
31052025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31062025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31072025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31082025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31092025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
31102025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
31112025-05-22T21:19:05.370ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
31122025-05-22T21:19:05.370ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31132025-05-22T21:19:05.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31142025-05-22T21:19:05.386ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
31152025-05-22T21:19:05.386ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
31162025-05-22T21:19:05.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31172025-05-22T21:19:05.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31182025-05-22T21:19:05.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31192025-05-22T21:19:05.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31202025-05-22T21:19:05.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31212025-05-22T21:19:05.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
31222025-05-22T21:19:05.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31232025-05-22T21:19:05.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31242025-05-22T21:19:05.460ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
31252025-05-22T21:19:05.477ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6aea2e-6651-41f1-93e7-c48cb99d2705", "content-length": "691", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
31262025-05-22T21:19:05.477ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
31272025-05-22T21:19:05.477ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
31282025-05-22T21:19:05.477ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
31292025-05-22T21:19:05.478ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.790535ms iteration = 4 status = {}
31302025-05-22T21:19:05.599ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "16301ce3-b3b0-42ea-a76c-05095ebdf0f5", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
31312025-05-22T21:19:05.599ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
31322025-05-22T21:19:05.599ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
31332025-05-22T21:19:05.599ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8a2d35b-88cd-454a-a9e7-dd1222c4b7d7", "content-length": "682", "date": "Thu, 22 May 2025 21:19:05 GMT"} })
31342025-05-22T21:19:05.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31352025-05-22T21:19:05.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31362025-05-22T21:19:05.604ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31372025-05-22T21:19:05.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31382025-05-22T21:19:05.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31392025-05-22T21:19:05.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31402025-05-22T21:19:05.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31412025-05-22T21:19:05.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31422025-05-22T21:19:05.618ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 533.472518ms iteration = 4 status = {}
31432025-05-22T21:19:06.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9f4a540b-b2c1-41b5-bab4-709e849afb66 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31442025-05-22T21:19:06.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9f4a540b-b2c1-41b5-bab4-709e849afb66 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31452025-05-22T21:19:06.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2300 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9f4a540b-b2c1-41b5-bab4-709e849afb66 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31462025-05-22T21:19:07.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 236126e1-bbc2-467e-992c-8c61f9f84dd5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31472025-05-22T21:19:07.139ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 236126e1-bbc2-467e-992c-8c61f9f84dd5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31482025-05-22T21:19:07.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2036 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 236126e1-bbc2-467e-992c-8c61f9f84dd5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31492025-05-22T21:19:08.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ba353ff-cca8-4340-a84b-120fd4c7856d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31502025-05-22T21:19:08.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ba353ff-cca8-4340-a84b-120fd4c7856d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31512025-05-22T21:19:08.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ba353ff-cca8-4340-a84b-120fd4c7856d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31522025-05-22T21:19:08.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = a606be26-57e5-49e9-9c1f-b44e07e0a13a response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
31532025-05-22T21:19:09.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26284160-a1c3-4a03-9fef-e0df03852ba2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31542025-05-22T21:19:09.171ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26284160-a1c3-4a03-9fef-e0df03852ba2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31552025-05-22T21:19:09.174ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3390 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26284160-a1c3-4a03-9fef-e0df03852ba2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31562025-05-22T21:19:10.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98f1470e-3019-45c9-8a9e-791fb9fcd657 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31572025-05-22T21:19:10.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98f1470e-3019-45c9-8a9e-791fb9fcd657 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31582025-05-22T21:19:10.190ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98f1470e-3019-45c9-8a9e-791fb9fcd657 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31592025-05-22T21:19:11.203ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 23788a65-32ec-4a15-b24f-b93ee078b453 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31602025-05-22T21:19:11.204ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 23788a65-32ec-4a15-b24f-b93ee078b453 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31612025-05-22T21:19:11.206ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 23788a65-32ec-4a15-b24f-b93ee078b453 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31622025-05-22T21:19:12.219ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8448e750-9941-4660-8eff-dfeeab52056a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31632025-05-22T21:19:12.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8448e750-9941-4660-8eff-dfeeab52056a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31642025-05-22T21:19:12.221ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8448e750-9941-4660-8eff-dfeeab52056a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31652025-05-22T21:19:13.234ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db06023a-baa5-4fdc-8673-fb13abb7757e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31662025-05-22T21:19:13.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db06023a-baa5-4fdc-8673-fb13abb7757e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31672025-05-22T21:19:13.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db06023a-baa5-4fdc-8673-fb13abb7757e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31682025-05-22T21:19:14.251ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31fd80ec-e486-417d-ac96-ed29f7a9ee2d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31692025-05-22T21:19:14.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31fd80ec-e486-417d-ac96-ed29f7a9ee2d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31702025-05-22T21:19:14.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31fd80ec-e486-417d-ac96-ed29f7a9ee2d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31712025-05-22T21:19:15.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
31722025-05-22T21:19:15.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31732025-05-22T21:19:15.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
31742025-05-22T21:19:15.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31752025-05-22T21:19:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31762025-05-22T21:19:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31772025-05-22T21:19:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31782025-05-22T21:19:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
31792025-05-22T21:19:15.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31802025-05-22T21:19:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31812025-05-22T21:19:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31822025-05-22T21:19:15.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31832025-05-22T21:19:15.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
31842025-05-22T21:19:15.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
31852025-05-22T21:19:15.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31862025-05-22T21:19:15.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
31872025-05-22T21:19:15.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
31882025-05-22T21:19:15.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.706153ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
31892025-05-22T21:19:15.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31902025-05-22T21:19:15.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31912025-05-22T21:19:15.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.200695ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
31922025-05-22T21:19:15.267ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e1e7b63-ca8d-4f85-b2a6-5c8bb3b99401 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31932025-05-22T21:19:15.267ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e1e7b63-ca8d-4f85-b2a6-5c8bb3b99401 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31942025-05-22T21:19:15.269ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e1e7b63-ca8d-4f85-b2a6-5c8bb3b99401 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31952025-05-22T21:19:16.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0d2066fa-8323-43a3-a43a-c4e91452938a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31962025-05-22T21:19:16.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0d2066fa-8323-43a3-a43a-c4e91452938a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31972025-05-22T21:19:16.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1959 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0d2066fa-8323-43a3-a43a-c4e91452938a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31982025-05-22T21:19:17.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e236f89-02c8-4c46-9382-682208adfb3d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
31992025-05-22T21:19:17.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e236f89-02c8-4c46-9382-682208adfb3d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32002025-05-22T21:19:17.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e236f89-02c8-4c46-9382-682208adfb3d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32012025-05-22T21:19:18.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 538 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 34b00e5b-247f-4d72-8747-76f07e75b89c response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
32022025-05-22T21:19:18.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60d0ddc0-a51b-4b7c-9dbe-5bdefef4b626 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32032025-05-22T21:19:18.314ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60d0ddc0-a51b-4b7c-9dbe-5bdefef4b626 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32042025-05-22T21:19:18.316ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60d0ddc0-a51b-4b7c-9dbe-5bdefef4b626 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32052025-05-22T21:19:19.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0314cc86-0081-4ed5-86d3-867def158e5a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32062025-05-22T21:19:19.330ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0314cc86-0081-4ed5-86d3-867def158e5a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32072025-05-22T21:19:19.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0314cc86-0081-4ed5-86d3-867def158e5a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32082025-05-22T21:19:20.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 964a774e-bd9e-455b-a842-8321902bcce9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32092025-05-22T21:19:20.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 964a774e-bd9e-455b-a842-8321902bcce9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32102025-05-22T21:19:20.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2781 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 964a774e-bd9e-455b-a842-8321902bcce9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32112025-05-22T21:19:21.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c08a1912-f133-41a3-86a7-89ae598c26f8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32122025-05-22T21:19:21.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c08a1912-f133-41a3-86a7-89ae598c26f8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32132025-05-22T21:19:21.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c08a1912-f133-41a3-86a7-89ae598c26f8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32142025-05-22T21:19:22.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f7dc180-185f-46e7-9b68-ebfd606c0c94 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32152025-05-22T21:19:22.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f7dc180-185f-46e7-9b68-ebfd606c0c94 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32162025-05-22T21:19:22.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f7dc180-185f-46e7-9b68-ebfd606c0c94 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32172025-05-22T21:19:23.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b221d09-a2e9-4456-97a8-1afce9c6c737 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32182025-05-22T21:19:23.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b221d09-a2e9-4456-97a8-1afce9c6c737 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32192025-05-22T21:19:23.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b221d09-a2e9-4456-97a8-1afce9c6c737 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32202025-05-22T21:19:24.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53b38cb9-05a3-4534-b0c6-c90ca6429ae4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32212025-05-22T21:19:24.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53b38cb9-05a3-4534-b0c6-c90ca6429ae4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32222025-05-22T21:19:24.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53b38cb9-05a3-4534-b0c6-c90ca6429ae4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32232025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
32242025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32252025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
32262025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32272025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32282025-05-22T21:19:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32292025-05-22T21:19:25.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32302025-05-22T21:19:25.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32312025-05-22T21:19:25.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32322025-05-22T21:19:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32332025-05-22T21:19:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32342025-05-22T21:19:25.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.799191ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32352025-05-22T21:19:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32362025-05-22T21:19:25.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32372025-05-22T21:19:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32382025-05-22T21:19:25.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32392025-05-22T21:19:25.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
32402025-05-22T21:19:25.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32412025-05-22T21:19:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32422025-05-22T21:19:25.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
32432025-05-22T21:19:25.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.363048ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
32442025-05-22T21:19:25.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c67b365-520f-4acc-8a62-f19370d5239d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32452025-05-22T21:19:25.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c67b365-520f-4acc-8a62-f19370d5239d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32462025-05-22T21:19:25.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c67b365-520f-4acc-8a62-f19370d5239d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32472025-05-22T21:19:26.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2e3c93ea-c4d8-4e28-9bdd-9dd13e4a91f9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32482025-05-22T21:19:26.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2e3c93ea-c4d8-4e28-9bdd-9dd13e4a91f9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32492025-05-22T21:19:26.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2303 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2e3c93ea-c4d8-4e28-9bdd-9dd13e4a91f9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32502025-05-22T21:19:27.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5367a4dd-8380-4364-bf45-65f578dcc9ad roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32512025-05-22T21:19:27.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5367a4dd-8380-4364-bf45-65f578dcc9ad resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32522025-05-22T21:19:27.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5367a4dd-8380-4364-bf45-65f578dcc9ad response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32532025-05-22T21:19:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 863 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 177fc89c-5555-4dd7-93dc-910bc67e9520 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
32542025-05-22T21:19:28.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = edddca48-dee5-414a-bcd4-500163e8f583 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32552025-05-22T21:19:28.471ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = edddca48-dee5-414a-bcd4-500163e8f583 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32562025-05-22T21:19:28.473ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = edddca48-dee5-414a-bcd4-500163e8f583 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32572025-05-22T21:19:29.487ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83930e70-4cc6-4371-b26f-5f6eeda81bda roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32582025-05-22T21:19:29.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83930e70-4cc6-4371-b26f-5f6eeda81bda resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32592025-05-22T21:19:29.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83930e70-4cc6-4371-b26f-5f6eeda81bda response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32602025-05-22T21:19:30.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 89e2bedd-db50-4ccb-bd5f-399b339508d0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32612025-05-22T21:19:30.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 89e2bedd-db50-4ccb-bd5f-399b339508d0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32622025-05-22T21:19:30.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 89e2bedd-db50-4ccb-bd5f-399b339508d0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32632025-05-22T21:19:31.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b620feff-7e7c-4191-ad52-3eb657209f67 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32642025-05-22T21:19:31.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b620feff-7e7c-4191-ad52-3eb657209f67 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32652025-05-22T21:19:31.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b620feff-7e7c-4191-ad52-3eb657209f67 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32662025-05-22T21:19:32.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3362327-602d-4f0c-b524-082984238224 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32672025-05-22T21:19:32.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3362327-602d-4f0c-b524-082984238224 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32682025-05-22T21:19:32.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3362327-602d-4f0c-b524-082984238224 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32692025-05-22T21:19:33.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d791c90b-0cc6-45e3-ae1e-493e68505cdc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32702025-05-22T21:19:33.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d791c90b-0cc6-45e3-ae1e-493e68505cdc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32712025-05-22T21:19:33.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d791c90b-0cc6-45e3-ae1e-493e68505cdc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32722025-05-22T21:19:34.569ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 549fa295-3302-4327-a8da-f535c146570f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32732025-05-22T21:19:34.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 549fa295-3302-4327-a8da-f535c146570f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32742025-05-22T21:19:34.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2270 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 549fa295-3302-4327-a8da-f535c146570f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
32752025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
32762025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
32772025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32782025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
32792025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
32802025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32812025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
32822025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
32832025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32842025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
32852025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
32862025-05-22T21:19:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
32872025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
32882025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
32892025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32902025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
32912025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
32922025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
32932025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
32942025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32952025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
32962025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32972025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
32982025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
32992025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
33002025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
33012025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
33022025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
33032025-05-22T21:19:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
33042025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33052025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
33062025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
33072025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
33082025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33092025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 3 reason = Timeout
33102025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
33112025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
33122025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
33132025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33142025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
33152025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33162025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
33172025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
33182025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
33192025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
33202025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
33212025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
33222025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
33232025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33242025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33252025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 5 reason = Timeout
33262025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
33272025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
33282025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
33292025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
33302025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
33312025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
33322025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
33332025-05-22T21:19:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
33342025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
33352025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.28\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
33362025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
33372025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
33382025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
33392025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
33402025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
33412025-05-22T21:19:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:09:35.085614811 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
33422025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
33432025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33442025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
33452025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33462025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33472025-05-22T21:19:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
33482025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33492025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
33502025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33512025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
33522025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33532025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33542025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
33552025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
33562025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33572025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
33582025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
33592025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
33602025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33612025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33622025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
33632025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33642025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
33652025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33662025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
33672025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
33682025-05-22T21:19:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 229483984 } })
33692025-05-22T21:19:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 229485284 } })
33702025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 3 reason = Timeout
33712025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
33722025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
33732025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
33742025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
33752025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
33762025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.416481ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
33772025-05-22T21:19:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
33782025-05-22T21:19:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.404671ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
33792025-05-22T21:19:35.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 232269136 } })
33802025-05-22T21:19:35.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
33812025-05-22T21:19:35.090ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.075175ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
33822025-05-22T21:19:35.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33832025-05-22T21:19:35.091ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33842025-05-22T21:19:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33852025-05-22T21:19:35.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33862025-05-22T21:19:35.093ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 236827723 } })
33872025-05-22T21:19:35.093ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
33882025-05-22T21:19:35.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33892025-05-22T21:19:35.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33902025-05-22T21:19:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33912025-05-22T21:19:35.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33922025-05-22T21:19:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33932025-05-22T21:19:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
33942025-05-22T21:19:35.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
33952025-05-22T21:19:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
33962025-05-22T21:19:35.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33972025-05-22T21:19:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33982025-05-22T21:19:35.111ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33992025-05-22T21:19:35.111ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
34002025-05-22T21:19:35.111ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 26.460354ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
34012025-05-22T21:19:35.117ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 32.006617ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
34022025-05-22T21:19:35.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34032025-05-22T21:19:35.126ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:09:35.085614811 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
34042025-05-22T21:19:35.126ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 40.558514ms iteration = 3 status = {"expiration":"2025-05-22T21:09:35.085614811Z","pruned":[]}
34052025-05-22T21:19:35.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34062025-05-22T21:19:35.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34072025-05-22T21:19:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34082025-05-22T21:19:35.141ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
34092025-05-22T21:19:35.141ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 55.396135ms iteration = 3 status = {"by_rx":{},"error":null}
34102025-05-22T21:19:35.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34112025-05-22T21:19:35.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.973271ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
34122025-05-22T21:19:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
34132025-05-22T21:19:35.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34142025-05-22T21:19:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34152025-05-22T21:19:35.157ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34162025-05-22T21:19:35.157ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
34172025-05-22T21:19:35.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34182025-05-22T21:19:35.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34192025-05-22T21:19:35.158ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34202025-05-22T21:19:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
34212025-05-22T21:19:35.164ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
34222025-05-22T21:19:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
34232025-05-22T21:19:35.168ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1084, tv_nsec: 311794109 } })
34242025-05-22T21:19:35.168ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
34252025-05-22T21:19:35.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
34262025-05-22T21:19:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
34272025-05-22T21:19:35.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34282025-05-22T21:19:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34292025-05-22T21:19:35.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34302025-05-22T21:19:35.173ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
34312025-05-22T21:19:35.173ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
34322025-05-22T21:19:35.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
34332025-05-22T21:19:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
34342025-05-22T21:19:35.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
34352025-05-22T21:19:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
34362025-05-22T21:19:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34372025-05-22T21:19:35.179ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
34382025-05-22T21:19:35.180ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
34392025-05-22T21:19:35.180ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
34402025-05-22T21:19:35.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34412025-05-22T21:19:35.180ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34422025-05-22T21:19:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34432025-05-22T21:19:35.181ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
34442025-05-22T21:19:35.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
34452025-05-22T21:19:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
34462025-05-22T21:19:35.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
34472025-05-22T21:19:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
34482025-05-22T21:19:35.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.8057ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
34492025-05-22T21:19:35.188ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
34502025-05-22T21:19:35.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
34512025-05-22T21:19:35.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34522025-05-22T21:19:35.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34532025-05-22T21:19:35.190ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34542025-05-22T21:19:35.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34552025-05-22T21:19:35.190ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34562025-05-22T21:19:35.192ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34572025-05-22T21:19:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 107.140374ms iteration = 5 status = {"errors":[],"requests_created_ok":[]}
34582025-05-22T21:19:35.192ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
34592025-05-22T21:19:35.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
34602025-05-22T21:19:35.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 108.682677ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
34612025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
34622025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 109.809543ms iteration = 3 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
34632025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34642025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
34652025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
34662025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34672025-05-22T21:19:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
34682025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
34692025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
34702025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34712025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34722025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
34732025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34742025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
34752025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34762025-05-22T21:19:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34772025-05-22T21:19:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
34782025-05-22T21:19:35.197ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
34792025-05-22T21:19:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
34802025-05-22T21:19:35.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34812025-05-22T21:19:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34822025-05-22T21:19:35.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
34832025-05-22T21:19:35.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
34842025-05-22T21:19:35.208ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34852025-05-22T21:19:35.208ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
34862025-05-22T21:19:35.208ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 123.642319ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
34872025-05-22T21:19:35.211ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
34882025-05-22T21:19:35.211ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34892025-05-22T21:19:35.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34902025-05-22T21:19:35.232ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
34912025-05-22T21:19:35.232ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
34922025-05-22T21:19:35.232ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
34932025-05-22T21:19:35.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
34942025-05-22T21:19:35.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
34952025-05-22T21:19:35.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34962025-05-22T21:19:35.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34972025-05-22T21:19:35.240ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34982025-05-22T21:19:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
34992025-05-22T21:19:35.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
35002025-05-22T21:19:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
35012025-05-22T21:19:35.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35022025-05-22T21:19:35.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35032025-05-22T21:19:35.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35042025-05-22T21:19:35.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.162373ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
35052025-05-22T21:19:35.245ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
35062025-05-22T21:19:35.245ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
35072025-05-22T21:19:35.245ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 160.61973ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
35082025-05-22T21:19:35.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 162.955464ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35092025-05-22T21:19:35.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.233137ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
35102025-05-22T21:19:35.258ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35112025-05-22T21:19:35.260ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
35122025-05-22T21:19:35.260ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
35132025-05-22T21:19:35.260ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 174.76415ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
35142025-05-22T21:19:35.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
35152025-05-22T21:19:35.264ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35162025-05-22T21:19:35.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35172025-05-22T21:19:35.269ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
35182025-05-22T21:19:35.269ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
35192025-05-22T21:19:35.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35202025-05-22T21:19:35.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35212025-05-22T21:19:35.271ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35222025-05-22T21:19:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
35232025-05-22T21:19:35.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
35242025-05-22T21:19:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
35252025-05-22T21:19:35.279ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
35262025-05-22T21:19:35.279ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 194.124558ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
35272025-05-22T21:19:35.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
35282025-05-22T21:19:35.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
35292025-05-22T21:19:35.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35302025-05-22T21:19:35.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35312025-05-22T21:19:35.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
35322025-05-22T21:19:35.303ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35332025-05-22T21:19:35.303ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38835687-78eb-41f9-9205-943d99c0e2f6", "content-length": "26", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
35342025-05-22T21:19:35.303ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35352025-05-22T21:19:35.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35362025-05-22T21:19:35.322ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
35372025-05-22T21:19:35.322ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35382025-05-22T21:19:35.322ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "86da5125-7acc-4862-b38e-68857e741678", "content-length": "26", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
35392025-05-22T21:19:35.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35402025-05-22T21:19:35.324ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
35412025-05-22T21:19:35.340ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35422025-05-22T21:19:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35432025-05-22T21:19:35.343ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
35442025-05-22T21:19:35.343ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
35452025-05-22T21:19:35.343ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35462025-05-22T21:19:35.343ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f933e1ba-e937-4ce1-93d5-f12db7c97059", "content-length": "26", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
35472025-05-22T21:19:35.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
35482025-05-22T21:19:35.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35492025-05-22T21:19:35.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35502025-05-22T21:19:35.344ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
35512025-05-22T21:19:35.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
35522025-05-22T21:19:35.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
35532025-05-22T21:19:35.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
35542025-05-22T21:19:35.348ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
35552025-05-22T21:19:35.348ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
35562025-05-22T21:19:35.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35572025-05-22T21:19:35.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35582025-05-22T21:19:35.349ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 264.571957ms iteration = 5 status = 0
35592025-05-22T21:19:35.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602025-05-22T21:19:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
35612025-05-22T21:19:35.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
35622025-05-22T21:19:35.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
35632025-05-22T21:19:35.359ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
35642025-05-22T21:19:35.380ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 294.862978ms iteration = 7 status = {"physical_disks_added":0}
35652025-05-22T21:19:35.386ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35662025-05-22T21:19:35.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35672025-05-22T21:19:35.387ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
35682025-05-22T21:19:35.387ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
35692025-05-22T21:19:35.387ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
35702025-05-22T21:19:35.387ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 301.989693ms iteration = 3 status = {"generation":2}
35712025-05-22T21:19:35.389ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
35722025-05-22T21:19:35.389ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 304.190676ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
35732025-05-22T21:19:35.402ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
35742025-05-22T21:19:35.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35752025-05-22T21:19:35.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35762025-05-22T21:19:35.418ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
35772025-05-22T21:19:35.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
35782025-05-22T21:19:35.488ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35792025-05-22T21:19:35.488ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35802025-05-22T21:19:35.488ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa75a6b9-1f51-4d05-a5f2-192cd8b95489", "content-length": "372", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
35812025-05-22T21:19:35.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35822025-05-22T21:19:35.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35832025-05-22T21:19:35.490ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35842025-05-22T21:19:35.490ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
35852025-05-22T21:19:35.490ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
35862025-05-22T21:19:35.490ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
35872025-05-22T21:19:35.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 405.673766ms iteration = 3 status = {"generation":1}
35882025-05-22T21:19:35.491ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35892025-05-22T21:19:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
35902025-05-22T21:19:35.493ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
35912025-05-22T21:19:35.494ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
35922025-05-22T21:19:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
35932025-05-22T21:19:35.494ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
35942025-05-22T21:19:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
35952025-05-22T21:19:35.512ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
35962025-05-22T21:19:35.512ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7e087bc5-94bb-4ad1-9c37-62c58129b64a", "date": "Thu, 22 May 2025 21:19:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35972025-05-22T21:19:35.512ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35982025-05-22T21:19:35.513ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "607cf496-653c-4343-a507-16d65f20e9ad", "date": "Thu, 22 May 2025 21:19:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
35992025-05-22T21:19:35.513ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36002025-05-22T21:19:35.515ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
36012025-05-22T21:19:35.515ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 430.086899ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
36022025-05-22T21:19:35.537ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
36032025-05-22T21:19:35.537ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 452.403322ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
36042025-05-22T21:19:35.539ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36052025-05-22T21:19:35.542ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36062025-05-22T21:19:35.542ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36072025-05-22T21:19:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36082025-05-22T21:19:35.544ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36092025-05-22T21:19:35.547ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
36102025-05-22T21:19:35.547ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36112025-05-22T21:19:35.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36122025-05-22T21:19:35.552ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
36132025-05-22T21:19:35.552ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5636be3e-94cc-442e-af4c-1981e0566f09", "date": "Thu, 22 May 2025 21:19:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36142025-05-22T21:19:35.552ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36152025-05-22T21:19:35.554ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "10460e49-456e-4640-bbcb-a581c5a23e20", "date": "Thu, 22 May 2025 21:19:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36162025-05-22T21:19:35.554ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36172025-05-22T21:19:35.554ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36182025-05-22T21:19:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36192025-05-22T21:19:35.555ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
36202025-05-22T21:19:35.555ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 470.172736ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
36212025-05-22T21:19:35.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "efc6fea9-f4dd-4afb-b227-4a8972bf9e7f", "date": "Thu, 22 May 2025 21:19:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36222025-05-22T21:19:35.556ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36232025-05-22T21:19:35.556ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.888551ms iteration = 5 status = null
36242025-05-22T21:19:35.558ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
36252025-05-22T21:19:35.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 473.015809ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
36262025-05-22T21:19:35.576ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 491.31019ms iteration = 5 status = {}
36272025-05-22T21:19:35.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = accf117e-baa4-4412-adc0-2312f1af18a0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36282025-05-22T21:19:35.587ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = accf117e-baa4-4412-adc0-2312f1af18a0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36292025-05-22T21:19:35.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = accf117e-baa4-4412-adc0-2312f1af18a0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36302025-05-22T21:19:35.646ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36312025-05-22T21:19:35.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36322025-05-22T21:19:35.667ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36332025-05-22T21:19:35.667ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36342025-05-22T21:19:35.684ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
36352025-05-22T21:19:35.686ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
36362025-05-22T21:19:35.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36372025-05-22T21:19:35.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36382025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
36392025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
36402025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
36412025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
36422025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36432025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36442025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36452025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36462025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
36472025-05-22T21:19:35.703ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
36482025-05-22T21:19:35.704ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
36492025-05-22T21:19:35.704ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36502025-05-22T21:19:35.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36512025-05-22T21:19:35.706ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
36522025-05-22T21:19:35.707ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
36532025-05-22T21:19:35.743ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a6881ce7-8903-44c8-a06a-ab2e4783597c", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
36542025-05-22T21:19:35.743ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36552025-05-22T21:19:35.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36562025-05-22T21:19:35.743ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff261e41-4175-4c9b-aa99-60ac6cf61828", "content-length": "691", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
36572025-05-22T21:19:35.743ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
36582025-05-22T21:19:35.743ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
36592025-05-22T21:19:35.743ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
36602025-05-22T21:19:35.746ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 660.976176ms iteration = 5 status = {}
36612025-05-22T21:19:35.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36622025-05-22T21:19:35.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36632025-05-22T21:19:35.750ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36642025-05-22T21:19:35.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36652025-05-22T21:19:35.754ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
36662025-05-22T21:19:35.754ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
36672025-05-22T21:19:35.755ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "478ebf4a-bf36-42fc-9171-5b782a820be9", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
36682025-05-22T21:19:35.756ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 671.834267ms iteration = 5 status = {}
36692025-05-22T21:19:35.858ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b2185b30-68a4-4f0d-8d98-6702c547ec52", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
36702025-05-22T21:19:35.858ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
36712025-05-22T21:19:35.858ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
36722025-05-22T21:19:35.858ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a26baff-00c7-4b7c-9315-04a6aa702a2d", "content-length": "682", "date": "Thu, 22 May 2025 21:19:35 GMT"} })
36732025-05-22T21:19:35.858ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36742025-05-22T21:19:35.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36752025-05-22T21:19:35.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36762025-05-22T21:19:35.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36772025-05-22T21:19:35.866ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36782025-05-22T21:19:35.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36792025-05-22T21:19:35.868ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36802025-05-22T21:19:35.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36812025-05-22T21:19:35.875ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 790.866439ms iteration = 5 status = {}
36822025-05-22T21:19:36.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e5f4ac3e-8d0d-4335-a0dd-813dc91aac77 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36832025-05-22T21:19:36.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e5f4ac3e-8d0d-4335-a0dd-813dc91aac77 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36842025-05-22T21:19:36.611ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e5f4ac3e-8d0d-4335-a0dd-813dc91aac77 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36852025-05-22T21:19:37.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cf13485-ab56-49f7-97c9-128d57ba9193 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36862025-05-22T21:19:37.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cf13485-ab56-49f7-97c9-128d57ba9193 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36872025-05-22T21:19:37.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2258 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cf13485-ab56-49f7-97c9-128d57ba9193 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36882025-05-22T21:19:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 4cf346ba-f769-4041-b046-690296f58ef0 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
36892025-05-22T21:19:38.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfd7862a-0878-4a4d-94e7-fd36faa8c541 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36902025-05-22T21:19:38.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfd7862a-0878-4a4d-94e7-fd36faa8c541 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36912025-05-22T21:19:38.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfd7862a-0878-4a4d-94e7-fd36faa8c541 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36922025-05-22T21:19:39.657ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 853bf4b0-51ed-4381-b918-953c0e056e92 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36932025-05-22T21:19:39.657ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 853bf4b0-51ed-4381-b918-953c0e056e92 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36942025-05-22T21:19:39.659ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 853bf4b0-51ed-4381-b918-953c0e056e92 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36952025-05-22T21:19:40.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3dfe0138-d9cb-4a66-8d26-8ec4e7fae791 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36962025-05-22T21:19:40.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3dfe0138-d9cb-4a66-8d26-8ec4e7fae791 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36972025-05-22T21:19:40.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3dfe0138-d9cb-4a66-8d26-8ec4e7fae791 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36982025-05-22T21:19:41.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4447f6d5-9eb4-484b-87b5-7097a996cc2d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
36992025-05-22T21:19:41.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4447f6d5-9eb4-484b-87b5-7097a996cc2d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37002025-05-22T21:19:41.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4447f6d5-9eb4-484b-87b5-7097a996cc2d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37012025-05-22T21:19:42.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0a3f57b-0d6e-49c9-91e8-409bb50d7b81 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37022025-05-22T21:19:42.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0a3f57b-0d6e-49c9-91e8-409bb50d7b81 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37032025-05-22T21:19:42.704ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1911 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0a3f57b-0d6e-49c9-91e8-409bb50d7b81 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37042025-05-22T21:19:43.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d401c9-f3e2-4545-9684-0a1182bd9f62 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37052025-05-22T21:19:43.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d401c9-f3e2-4545-9684-0a1182bd9f62 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37062025-05-22T21:19:43.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d401c9-f3e2-4545-9684-0a1182bd9f62 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37072025-05-22T21:19:44.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 775620c3-f912-4b29-8692-575da1e648f6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37082025-05-22T21:19:44.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 775620c3-f912-4b29-8692-575da1e648f6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37092025-05-22T21:19:44.737ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 775620c3-f912-4b29-8692-575da1e648f6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37102025-05-22T21:19:45.083ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
37112025-05-22T21:19:45.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37122025-05-22T21:19:45.083ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
37132025-05-22T21:19:45.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37142025-05-22T21:19:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37152025-05-22T21:19:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37162025-05-22T21:19:45.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37172025-05-22T21:19:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37182025-05-22T21:19:45.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37192025-05-22T21:19:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37202025-05-22T21:19:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37212025-05-22T21:19:45.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37222025-05-22T21:19:45.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37232025-05-22T21:19:45.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
37242025-05-22T21:19:45.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37252025-05-22T21:19:45.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37262025-05-22T21:19:45.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
37272025-05-22T21:19:45.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.570251ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
37282025-05-22T21:19:45.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37292025-05-22T21:19:45.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37302025-05-22T21:19:45.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.129888ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37312025-05-22T21:19:45.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978de38b-6f08-4efa-9e04-7daf181cbd2f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37322025-05-22T21:19:45.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978de38b-6f08-4efa-9e04-7daf181cbd2f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37332025-05-22T21:19:45.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978de38b-6f08-4efa-9e04-7daf181cbd2f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37342025-05-22T21:19:46.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52303fe5-2e6d-4f46-b57e-12b1f8cf8f62 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37352025-05-22T21:19:46.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52303fe5-2e6d-4f46-b57e-12b1f8cf8f62 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37362025-05-22T21:19:46.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52303fe5-2e6d-4f46-b57e-12b1f8cf8f62 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37372025-05-22T21:19:47.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faffec5b-35be-47de-89db-047a9c0768a8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37382025-05-22T21:19:47.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faffec5b-35be-47de-89db-047a9c0768a8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37392025-05-22T21:19:47.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faffec5b-35be-47de-89db-047a9c0768a8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37402025-05-22T21:19:48.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 558 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 9f9e3258-0570-4263-af2d-f5a05993806e response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
37412025-05-22T21:19:48.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34cfcf9e-40fc-47b0-90b0-c37e0834a9e3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37422025-05-22T21:19:48.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34cfcf9e-40fc-47b0-90b0-c37e0834a9e3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37432025-05-22T21:19:48.802ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34cfcf9e-40fc-47b0-90b0-c37e0834a9e3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37442025-05-22T21:19:49.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad90bb1-3fe8-4d29-984c-4b03bed5e693 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37452025-05-22T21:19:49.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad90bb1-3fe8-4d29-984c-4b03bed5e693 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37462025-05-22T21:19:49.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1983 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad90bb1-3fe8-4d29-984c-4b03bed5e693 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37472025-05-22T21:19:50.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d79c3b50-d215-4f0a-8afb-4bd77c9c46ca roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37482025-05-22T21:19:50.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d79c3b50-d215-4f0a-8afb-4bd77c9c46ca resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37492025-05-22T21:19:50.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d79c3b50-d215-4f0a-8afb-4bd77c9c46ca response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37502025-05-22T21:19:51.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 424e0111-c757-4702-bb89-21df3ff09afd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37512025-05-22T21:19:51.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 424e0111-c757-4702-bb89-21df3ff09afd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37522025-05-22T21:19:51.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 424e0111-c757-4702-bb89-21df3ff09afd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37532025-05-22T21:19:52.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3101878f-75a9-4a14-91b8-9f1ed757c795 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37542025-05-22T21:19:52.864ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3101878f-75a9-4a14-91b8-9f1ed757c795 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37552025-05-22T21:19:52.866ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3101878f-75a9-4a14-91b8-9f1ed757c795 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37562025-05-22T21:19:53.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1c1588e-73bf-407e-bc34-c79635e15b72 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37572025-05-22T21:19:53.880ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1c1588e-73bf-407e-bc34-c79635e15b72 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37582025-05-22T21:19:53.882ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1c1588e-73bf-407e-bc34-c79635e15b72 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37592025-05-22T21:19:54.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a5aa44e3-679e-4f52-ab8f-2de0d7f6d335 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37602025-05-22T21:19:54.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a5aa44e3-679e-4f52-ab8f-2de0d7f6d335 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37612025-05-22T21:19:54.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a5aa44e3-679e-4f52-ab8f-2de0d7f6d335 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37622025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
37632025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37642025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
37652025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37662025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37672025-05-22T21:19:55.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37682025-05-22T21:19:55.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37692025-05-22T21:19:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37702025-05-22T21:19:55.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37712025-05-22T21:19:55.086ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.162877ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37722025-05-22T21:19:55.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37732025-05-22T21:19:55.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37742025-05-22T21:19:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37752025-05-22T21:19:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37762025-05-22T21:19:55.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37772025-05-22T21:19:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37782025-05-22T21:19:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
37792025-05-22T21:19:55.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37802025-05-22T21:19:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37812025-05-22T21:19:55.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
37822025-05-22T21:19:55.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.501345ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
37832025-05-22T21:19:55.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3fab15a4-0028-4141-9169-fb51ec891189 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37842025-05-22T21:19:55.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3fab15a4-0028-4141-9169-fb51ec891189 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37852025-05-22T21:19:55.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2503 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3fab15a4-0028-4141-9169-fb51ec891189 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37862025-05-22T21:19:56.928ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a1b93f5e-db46-4818-9f5a-824a7fa2ab13 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37872025-05-22T21:19:56.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a1b93f5e-db46-4818-9f5a-824a7fa2ab13 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37882025-05-22T21:19:56.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a1b93f5e-db46-4818-9f5a-824a7fa2ab13 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37892025-05-22T21:19:57.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c848d99-c8a5-45fa-b823-34c768246250 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37902025-05-22T21:19:57.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c848d99-c8a5-45fa-b823-34c768246250 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37912025-05-22T21:19:57.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c848d99-c8a5-45fa-b823-34c768246250 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37922025-05-22T21:19:58.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 682 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 7951c985-687a-4082-9259-c6addfb4d67f response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
37932025-05-22T21:19:58.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d0bccbab-680e-4e9f-8ca7-9a16023f9e4b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37942025-05-22T21:19:58.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d0bccbab-680e-4e9f-8ca7-9a16023f9e4b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37952025-05-22T21:19:58.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d0bccbab-680e-4e9f-8ca7-9a16023f9e4b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37962025-05-22T21:19:59.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49d51b67-60df-4e46-a880-e87047d3020f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37972025-05-22T21:19:59.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49d51b67-60df-4e46-a880-e87047d3020f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37982025-05-22T21:19:59.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49d51b67-60df-4e46-a880-e87047d3020f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
37992025-05-22T21:20:00.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05c95442-e29c-4629-b2c6-1b6c5d6f50ee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38002025-05-22T21:20:00.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05c95442-e29c-4629-b2c6-1b6c5d6f50ee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38012025-05-22T21:20:00.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05c95442-e29c-4629-b2c6-1b6c5d6f50ee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38022025-05-22T21:20:02.008ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e45b3bc-6e6c-4711-a2d4-cfa125b7ddfb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38032025-05-22T21:20:02.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e45b3bc-6e6c-4711-a2d4-cfa125b7ddfb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38042025-05-22T21:20:02.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e45b3bc-6e6c-4711-a2d4-cfa125b7ddfb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38052025-05-22T21:20:03.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab6eb045-242e-4ce5-a544-19e77a46c4a1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38062025-05-22T21:20:03.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab6eb045-242e-4ce5-a544-19e77a46c4a1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38072025-05-22T21:20:03.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab6eb045-242e-4ce5-a544-19e77a46c4a1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38082025-05-22T21:20:04.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d5600fc-4e86-4efb-9c62-c30e128e3946 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38092025-05-22T21:20:04.041ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d5600fc-4e86-4efb-9c62-c30e128e3946 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38102025-05-22T21:20:04.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d5600fc-4e86-4efb-9c62-c30e128e3946 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38112025-05-22T21:20:05.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4e748c8-da83-400a-80dc-2ef93f0a93e0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38122025-05-22T21:20:05.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4e748c8-da83-400a-80dc-2ef93f0a93e0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38132025-05-22T21:20:05.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1838 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4e748c8-da83-400a-80dc-2ef93f0a93e0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
38142025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
38152025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
38162025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38172025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38182025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
38192025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
38202025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
38212025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38222025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
38232025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
38242025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38252025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
38262025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
38272025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38282025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
38292025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
38302025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
38312025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
38322025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38332025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
38342025-05-22T21:20:05.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
38352025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38362025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
38372025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
38382025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38392025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
38402025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
38412025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
38422025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
38432025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
38442025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
38452025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38462025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
38472025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38482025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
38492025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
38502025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
38512025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
38522025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
38532025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38542025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
38552025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
38562025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38572025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38582025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38592025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38602025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38612025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
38622025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38632025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
38642025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38652025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38662025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
38672025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
38682025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38692025-05-22T21:20:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
38702025-05-22T21:20:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
38712025-05-22T21:20:05.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38722025-05-22T21:20:05.090ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 234505178 } })
38732025-05-22T21:20:05.090ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
38742025-05-22T21:20:05.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38752025-05-22T21:20:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
38762025-05-22T21:20:05.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38772025-05-22T21:20:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38782025-05-22T21:20:05.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38792025-05-22T21:20:05.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38802025-05-22T21:20:05.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38812025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38822025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38832025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38842025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
38852025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38862025-05-22T21:20:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38872025-05-22T21:20:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
38882025-05-22T21:20:05.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
38892025-05-22T21:20:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
38902025-05-22T21:20:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
38912025-05-22T21:20:05.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38922025-05-22T21:20:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38932025-05-22T21:20:05.101ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 246055350 } })
38942025-05-22T21:20:05.102ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
38952025-05-22T21:20:05.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
38962025-05-22T21:20:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
38972025-05-22T21:20:05.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38982025-05-22T21:20:05.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38992025-05-22T21:20:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39002025-05-22T21:20:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39012025-05-22T21:20:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39022025-05-22T21:20:05.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 23.637572ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
39032025-05-22T21:20:05.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
39042025-05-22T21:20:05.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39052025-05-22T21:20:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39062025-05-22T21:20:05.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39072025-05-22T21:20:05.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39082025-05-22T21:20:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
39092025-05-22T21:20:05.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39102025-05-22T21:20:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39112025-05-22T21:20:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
39122025-05-22T21:20:05.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39132025-05-22T21:20:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39142025-05-22T21:20:05.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39152025-05-22T21:20:05.148ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39162025-05-22T21:20:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39172025-05-22T21:20:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39182025-05-22T21:20:05.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.937256ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
39192025-05-22T21:20:05.154ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39202025-05-22T21:20:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 70.991166ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
39212025-05-22T21:20:05.156ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39222025-05-22T21:20:05.156ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
39232025-05-22T21:20:05.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39242025-05-22T21:20:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39252025-05-22T21:20:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39262025-05-22T21:20:05.157ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39272025-05-22T21:20:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39282025-05-22T21:20:05.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39292025-05-22T21:20:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39302025-05-22T21:20:05.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39312025-05-22T21:20:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
39322025-05-22T21:20:05.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39332025-05-22T21:20:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
39342025-05-22T21:20:05.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39352025-05-22T21:20:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39362025-05-22T21:20:05.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39372025-05-22T21:20:05.170ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
39382025-05-22T21:20:05.170ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.271954ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
39392025-05-22T21:20:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39402025-05-22T21:20:05.170ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 86.399356ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
39412025-05-22T21:20:05.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
39422025-05-22T21:20:05.172ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39432025-05-22T21:20:05.172ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c42e0a28-38a1-40b6-831c-cc347bb449e2", "content-length": "26", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
39442025-05-22T21:20:05.172ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39452025-05-22T21:20:05.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39462025-05-22T21:20:05.180ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
39472025-05-22T21:20:05.180ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
39482025-05-22T21:20:05.180ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9db9eba0-3511-408f-b92e-6fe07e5cd3f4", "content-length": "26", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
39492025-05-22T21:20:05.180ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
39502025-05-22T21:20:05.183ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
39512025-05-22T21:20:05.210ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
39522025-05-22T21:20:05.210ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
39532025-05-22T21:20:05.210ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "70d03cca-327d-4bb1-839b-4bd4fd861d54", "content-length": "372", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
39542025-05-22T21:20:05.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39552025-05-22T21:20:05.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39562025-05-22T21:20:05.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39572025-05-22T21:20:05.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39582025-05-22T21:20:05.215ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39592025-05-22T21:20:05.215ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
39602025-05-22T21:20:05.215ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39612025-05-22T21:20:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
39622025-05-22T21:20:05.217ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1114, tv_nsec: 361536589 } })
39632025-05-22T21:20:05.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39642025-05-22T21:20:05.217ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
39652025-05-22T21:20:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
39662025-05-22T21:20:05.220ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39672025-05-22T21:20:05.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39682025-05-22T21:20:05.222ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 138.511811ms iteration = 6 status = 0
39692025-05-22T21:20:05.233ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
39702025-05-22T21:20:05.233ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 149.534036ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
39712025-05-22T21:20:05.242ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.946361ms iteration = 8 status = {"physical_disks_added":0}
39722025-05-22T21:20:05.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39732025-05-22T21:20:05.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39742025-05-22T21:20:05.253ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
39752025-05-22T21:20:05.253ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
39762025-05-22T21:20:05.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.622874ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
39772025-05-22T21:20:05.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 177.171016ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39782025-05-22T21:20:05.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 179.998939ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
39792025-05-22T21:20:05.266ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39802025-05-22T21:20:05.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39812025-05-22T21:20:05.268ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39822025-05-22T21:20:05.269ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39832025-05-22T21:20:05.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
39842025-05-22T21:20:05.270ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
39852025-05-22T21:20:05.270ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
39862025-05-22T21:20:05.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
39872025-05-22T21:20:05.270ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 186.364383ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39882025-05-22T21:20:05.282ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
39892025-05-22T21:20:05.282ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
39902025-05-22T21:20:05.282ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d9792f72-adfe-4ffd-abaa-607570a57e14", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
39912025-05-22T21:20:05.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39922025-05-22T21:20:05.282ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39932025-05-22T21:20:05.282ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 198.707607ms iteration = 6 status = {}
39942025-05-22T21:20:05.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39952025-05-22T21:20:05.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
39962025-05-22T21:20:05.285ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39972025-05-22T21:20:05.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
39982025-05-22T21:20:05.285ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 201.414748ms iteration = 6 status = null
39992025-05-22T21:20:05.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40002025-05-22T21:20:05.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40012025-05-22T21:20:05.291ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
40022025-05-22T21:20:05.291ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
40032025-05-22T21:20:05.292ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "099ea01a-b2e6-4f5e-a73e-619046c29742", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
40042025-05-22T21:20:05.292ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
40052025-05-22T21:20:05.292ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40062025-05-22T21:20:05.293ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbe0f279-9417-48fa-8d6a-529bf490db7b", "content-length": "26", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
40072025-05-22T21:20:05.293ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40082025-05-22T21:20:05.293ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 209.257654ms iteration = 6 status = {}
40092025-05-22T21:20:05.294ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
40102025-05-22T21:20:05.311ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 227.469475ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
40112025-05-22T21:20:05.314ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
40122025-05-22T21:20:05.314ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 230.223066ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
40132025-05-22T21:20:05.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40142025-05-22T21:20:05.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40152025-05-22T21:20:05.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40162025-05-22T21:20:05.371ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40172025-05-22T21:20:05.371ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40182025-05-22T21:20:05.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40192025-05-22T21:20:05.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40202025-05-22T21:20:05.375ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40212025-05-22T21:20:05.375ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40222025-05-22T21:20:05.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40232025-05-22T21:20:05.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40242025-05-22T21:20:05.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40252025-05-22T21:20:05.405ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
40262025-05-22T21:20:05.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40272025-05-22T21:20:05.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40282025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
40292025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
40302025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
40312025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
40322025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40332025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40342025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40352025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40362025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
40372025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
40382025-05-22T21:20:05.416ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
40392025-05-22T21:20:05.416ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40402025-05-22T21:20:05.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40412025-05-22T21:20:05.419ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
40422025-05-22T21:20:05.419ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
40432025-05-22T21:20:05.420ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
40442025-05-22T21:20:05.457ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ed437d5-e0fa-4399-8b1c-c51e5ae8e0ba", "content-length": "691", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
40452025-05-22T21:20:05.457ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
40462025-05-22T21:20:05.457ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
40472025-05-22T21:20:05.457ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
40482025-05-22T21:20:05.459ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 374.710967ms iteration = 6 status = {}
40492025-05-22T21:20:05.553ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1cadb310-2243-40b6-b6cc-35dc6da43e66", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
40502025-05-22T21:20:05.554ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
40512025-05-22T21:20:05.554ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
40522025-05-22T21:20:05.555ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "706be326-9cf5-4934-8463-7938aee18a65", "content-length": "682", "date": "Thu, 22 May 2025 21:20:05 GMT"} })
40532025-05-22T21:20:05.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40542025-05-22T21:20:05.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40552025-05-22T21:20:05.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40562025-05-22T21:20:05.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40572025-05-22T21:20:05.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40582025-05-22T21:20:05.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40592025-05-22T21:20:05.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40602025-05-22T21:20:05.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40612025-05-22T21:20:05.585ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 501.255369ms iteration = 6 status = {}
40622025-05-22T21:20:06.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e710134e-b0df-41d2-a901-839b975cc9ed roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40632025-05-22T21:20:06.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e710134e-b0df-41d2-a901-839b975cc9ed resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40642025-05-22T21:20:06.079ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2448 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e710134e-b0df-41d2-a901-839b975cc9ed response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40652025-05-22T21:20:07.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21bbcb6c-4bcd-4fc7-8268-4c3903ce6ad2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40662025-05-22T21:20:07.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21bbcb6c-4bcd-4fc7-8268-4c3903ce6ad2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40672025-05-22T21:20:07.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21bbcb6c-4bcd-4fc7-8268-4c3903ce6ad2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40682025-05-22T21:20:08.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bf921be-a9e5-4c0e-a296-26bfa2d30a16 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40692025-05-22T21:20:08.109ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bf921be-a9e5-4c0e-a296-26bfa2d30a16 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40702025-05-22T21:20:08.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bf921be-a9e5-4c0e-a296-26bfa2d30a16 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40712025-05-22T21:20:08.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 519 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 2e48ab35-c2ae-4813-8043-1ee2cbc7eeff response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
40722025-05-22T21:20:09.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6afbbebe-5fe2-49f5-8c1e-e985b20e4955 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40732025-05-22T21:20:09.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6afbbebe-5fe2-49f5-8c1e-e985b20e4955 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40742025-05-22T21:20:09.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2578 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6afbbebe-5fe2-49f5-8c1e-e985b20e4955 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40752025-05-22T21:20:10.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cde4cca-ad77-4f9a-a712-d32e9d91f21c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40762025-05-22T21:20:10.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cde4cca-ad77-4f9a-a712-d32e9d91f21c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40772025-05-22T21:20:10.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cde4cca-ad77-4f9a-a712-d32e9d91f21c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40782025-05-22T21:20:11.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1fb0e394-7f7d-4d96-b5c5-46ab4ff355c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40792025-05-22T21:20:11.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1fb0e394-7f7d-4d96-b5c5-46ab4ff355c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40802025-05-22T21:20:11.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2725 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1fb0e394-7f7d-4d96-b5c5-46ab4ff355c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40812025-05-22T21:20:12.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 950b7275-99bc-47ad-ad10-d020124232b8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40822025-05-22T21:20:12.174ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 950b7275-99bc-47ad-ad10-d020124232b8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40832025-05-22T21:20:12.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 950b7275-99bc-47ad-ad10-d020124232b8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40842025-05-22T21:20:13.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a822b069-313d-495f-8ad3-1c5acf5bfd44 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40852025-05-22T21:20:13.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a822b069-313d-495f-8ad3-1c5acf5bfd44 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40862025-05-22T21:20:13.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2603 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a822b069-313d-495f-8ad3-1c5acf5bfd44 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40872025-05-22T21:20:14.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9577b1eb-3c64-46ff-876e-e7044a6aaa4a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40882025-05-22T21:20:14.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9577b1eb-3c64-46ff-876e-e7044a6aaa4a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40892025-05-22T21:20:14.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9577b1eb-3c64-46ff-876e-e7044a6aaa4a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
40902025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
40912025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40922025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
40932025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40942025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40952025-05-22T21:20:15.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40962025-05-22T21:20:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40972025-05-22T21:20:15.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40982025-05-22T21:20:15.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40992025-05-22T21:20:15.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41002025-05-22T21:20:15.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41012025-05-22T21:20:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41022025-05-22T21:20:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41032025-05-22T21:20:15.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
41042025-05-22T21:20:15.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41052025-05-22T21:20:15.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41062025-05-22T21:20:15.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
41072025-05-22T21:20:15.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.092388ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
41082025-05-22T21:20:15.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41092025-05-22T21:20:15.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41102025-05-22T21:20:15.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.779942ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41112025-05-22T21:20:15.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 35080248-af67-4fd4-9e93-e630c2a1d59e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41122025-05-22T21:20:15.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 35080248-af67-4fd4-9e93-e630c2a1d59e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41132025-05-22T21:20:15.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 35080248-af67-4fd4-9e93-e630c2a1d59e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41142025-05-22T21:20:16.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7918a66b-8366-4ccc-8a01-6d71adfb9c19 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41152025-05-22T21:20:16.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7918a66b-8366-4ccc-8a01-6d71adfb9c19 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41162025-05-22T21:20:16.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7918a66b-8366-4ccc-8a01-6d71adfb9c19 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41172025-05-22T21:20:17.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bde0e67-5c32-4c7a-b7cf-e50e83bc9ee7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41182025-05-22T21:20:17.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bde0e67-5c32-4c7a-b7cf-e50e83bc9ee7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41192025-05-22T21:20:17.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bde0e67-5c32-4c7a-b7cf-e50e83bc9ee7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41202025-05-22T21:20:18.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = f20222f6-c794-4ac0-a064-ab11882f409e response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
41212025-05-22T21:20:18.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190ab88d-9502-4ea6-a1b5-934a19142b03 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41222025-05-22T21:20:18.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190ab88d-9502-4ea6-a1b5-934a19142b03 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41232025-05-22T21:20:18.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190ab88d-9502-4ea6-a1b5-934a19142b03 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41242025-05-22T21:20:19.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf0c8ffb-8175-48cf-9642-6c28af5263c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41252025-05-22T21:20:19.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf0c8ffb-8175-48cf-9642-6c28af5263c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41262025-05-22T21:20:19.286ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf0c8ffb-8175-48cf-9642-6c28af5263c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41272025-05-22T21:20:20.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf80b165-bba5-4d69-b880-cedec228b2bf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41282025-05-22T21:20:20.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf80b165-bba5-4d69-b880-cedec228b2bf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41292025-05-22T21:20:20.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cf80b165-bba5-4d69-b880-cedec228b2bf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41302025-05-22T21:20:21.315ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5cd2bbaa-6acc-4789-9f66-f641280d0507 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41312025-05-22T21:20:21.315ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5cd2bbaa-6acc-4789-9f66-f641280d0507 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41322025-05-22T21:20:21.317ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5cd2bbaa-6acc-4789-9f66-f641280d0507 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41332025-05-22T21:20:22.330ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6939fcc-457c-48e8-93f8-56381b4dac96 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41342025-05-22T21:20:22.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6939fcc-457c-48e8-93f8-56381b4dac96 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41352025-05-22T21:20:22.333ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6939fcc-457c-48e8-93f8-56381b4dac96 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41362025-05-22T21:20:23.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 46d43318-d2e1-4c31-a9b5-808c8310e740 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41372025-05-22T21:20:23.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 46d43318-d2e1-4c31-a9b5-808c8310e740 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41382025-05-22T21:20:23.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 46d43318-d2e1-4c31-a9b5-808c8310e740 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41392025-05-22T21:20:24.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16fa1660-90b1-4f89-b622-0a9411ad0ba4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41402025-05-22T21:20:24.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16fa1660-90b1-4f89-b622-0a9411ad0ba4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41412025-05-22T21:20:24.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16fa1660-90b1-4f89-b622-0a9411ad0ba4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41422025-05-22T21:20:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
41432025-05-22T21:20:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41442025-05-22T21:20:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
41452025-05-22T21:20:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41462025-05-22T21:20:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41472025-05-22T21:20:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41482025-05-22T21:20:25.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41492025-05-22T21:20:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41502025-05-22T21:20:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41512025-05-22T21:20:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41522025-05-22T21:20:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41532025-05-22T21:20:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41542025-05-22T21:20:25.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41552025-05-22T21:20:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
41562025-05-22T21:20:25.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41572025-05-22T21:20:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41582025-05-22T21:20:25.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
41592025-05-22T21:20:25.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.324662ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
41602025-05-22T21:20:25.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41612025-05-22T21:20:25.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41622025-05-22T21:20:25.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.626291ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
41632025-05-22T21:20:25.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b0036b6-1871-4075-8631-b841ea8853cc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41642025-05-22T21:20:25.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b0036b6-1871-4075-8631-b841ea8853cc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41652025-05-22T21:20:25.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2311 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b0036b6-1871-4075-8631-b841ea8853cc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41662025-05-22T21:20:26.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 73afcb90-b9e1-4882-92f7-58217decb2bf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41672025-05-22T21:20:26.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 73afcb90-b9e1-4882-92f7-58217decb2bf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41682025-05-22T21:20:26.396ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 73afcb90-b9e1-4882-92f7-58217decb2bf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41692025-05-22T21:20:27.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25a9534d-e64a-45a9-98c4-63d06db3f51a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41702025-05-22T21:20:27.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25a9534d-e64a-45a9-98c4-63d06db3f51a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41712025-05-22T21:20:27.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25a9534d-e64a-45a9-98c4-63d06db3f51a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41722025-05-22T21:20:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 456 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 77a190fa-0fb5-4e1b-a359-b24fb5a9d3c1 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
41732025-05-22T21:20:28.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2fec66a4-8284-41b7-9b68-79a9dcfc3091 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41742025-05-22T21:20:28.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2fec66a4-8284-41b7-9b68-79a9dcfc3091 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41752025-05-22T21:20:28.427ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2fec66a4-8284-41b7-9b68-79a9dcfc3091 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41762025-05-22T21:20:29.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac0df5f7-e8c4-4f54-9822-78f5d8e1ae15 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41772025-05-22T21:20:29.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac0df5f7-e8c4-4f54-9822-78f5d8e1ae15 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41782025-05-22T21:20:29.443ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2133 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac0df5f7-e8c4-4f54-9822-78f5d8e1ae15 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41792025-05-22T21:20:30.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a2415967-492b-4a10-ac49-81bd6accfae7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41802025-05-22T21:20:30.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a2415967-492b-4a10-ac49-81bd6accfae7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41812025-05-22T21:20:30.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a2415967-492b-4a10-ac49-81bd6accfae7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41822025-05-22T21:20:31.474ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 168bed00-5391-4145-b5dc-9f264db4ae14 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41832025-05-22T21:20:31.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 168bed00-5391-4145-b5dc-9f264db4ae14 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41842025-05-22T21:20:31.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 168bed00-5391-4145-b5dc-9f264db4ae14 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41852025-05-22T21:20:32.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1eef071-43e3-489f-9eef-91e53dd3d954 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41862025-05-22T21:20:32.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1eef071-43e3-489f-9eef-91e53dd3d954 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41872025-05-22T21:20:32.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1544 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1eef071-43e3-489f-9eef-91e53dd3d954 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41882025-05-22T21:20:33.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ce9f62a-b4eb-49ba-9c8e-909ec82434d6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41892025-05-22T21:20:33.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ce9f62a-b4eb-49ba-9c8e-909ec82434d6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41902025-05-22T21:20:33.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ce9f62a-b4eb-49ba-9c8e-909ec82434d6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41912025-05-22T21:20:34.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34d16691-e141-4b5a-b448-7842d7841e7d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41922025-05-22T21:20:34.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34d16691-e141-4b5a-b448-7842d7841e7d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41932025-05-22T21:20:34.523ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2406 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34d16691-e141-4b5a-b448-7842d7841e7d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
41942025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
41952025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41962025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
41972025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41982025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
41992025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42002025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
42012025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
42022025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42032025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42042025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
42052025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
42062025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
42072025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42082025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
42092025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
42102025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42112025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42122025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
42132025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42142025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42152025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
42162025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
42172025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
42182025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
42192025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42202025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42212025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
42222025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42232025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 4 reason = Timeout
42242025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
42252025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
42262025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42272025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42282025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
42292025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
42302025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42312025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
42322025-05-22T21:20:35.084ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
42332025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
42342025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.8\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
42352025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
42362025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
42372025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42382025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
42392025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42402025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
42412025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42422025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
42432025-05-22T21:20:35.084ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
42442025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42452025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
42462025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
42472025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
42482025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
42492025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
42502025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
42512025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
42522025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
42532025-05-22T21:20:35.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42542025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
42552025-05-22T21:20:35.084ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:10:35.084767135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42562025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42572025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42582025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
42592025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42602025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
42612025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42622025-05-22T21:20:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42632025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
42642025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
42652025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42662025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
42672025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42682025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
42692025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
42702025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42712025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42722025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42732025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
42742025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
42752025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42762025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42772025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
42782025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
42792025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42802025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
42812025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42822025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42832025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42842025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42852025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42862025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
42872025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
42882025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
42892025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
42902025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
42912025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42922025-05-22T21:20:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 229159858 } })
42932025-05-22T21:20:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 229161728 } })
42942025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42952025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42962025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
42972025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42982025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42992025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43002025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43012025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 4 reason = Timeout
43022025-05-22T21:20:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
43032025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43042025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
43052025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43062025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.628894ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43072025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
43082025-05-22T21:20:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.712386ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
43092025-05-22T21:20:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.565508ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
43102025-05-22T21:20:35.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43112025-05-22T21:20:35.090ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.3412ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43122025-05-22T21:20:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43132025-05-22T21:20:35.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43142025-05-22T21:20:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43152025-05-22T21:20:35.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43162025-05-22T21:20:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43172025-05-22T21:20:35.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43182025-05-22T21:20:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43192025-05-22T21:20:35.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43202025-05-22T21:20:35.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43212025-05-22T21:20:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43222025-05-22T21:20:35.101ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43232025-05-22T21:20:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43242025-05-22T21:20:35.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43252025-05-22T21:20:35.102ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43262025-05-22T21:20:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43272025-05-22T21:20:35.103ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 246910952 } })
43282025-05-22T21:20:35.103ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
43292025-05-22T21:20:35.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43302025-05-22T21:20:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43312025-05-22T21:20:35.116ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 31.399277ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
43322025-05-22T21:20:35.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 261567300 } })
43332025-05-22T21:20:35.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 33.411527ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
43342025-05-22T21:20:35.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
43352025-05-22T21:20:35.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43362025-05-22T21:20:35.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
43372025-05-22T21:20:35.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43382025-05-22T21:20:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43392025-05-22T21:20:35.133ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 48.987239ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43402025-05-22T21:20:35.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43412025-05-22T21:20:35.140ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:10:35.084767135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43422025-05-22T21:20:35.140ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 55.406495ms iteration = 4 status = {"expiration":"2025-05-22T21:10:35.084767135Z","pruned":[]}
43432025-05-22T21:20:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43442025-05-22T21:20:35.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43452025-05-22T21:20:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43462025-05-22T21:20:35.144ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43472025-05-22T21:20:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43482025-05-22T21:20:35.148ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43492025-05-22T21:20:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43502025-05-22T21:20:35.151ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43512025-05-22T21:20:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43522025-05-22T21:20:35.154ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43532025-05-22T21:20:35.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43542025-05-22T21:20:35.161ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43552025-05-22T21:20:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43562025-05-22T21:20:35.163ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43572025-05-22T21:20:35.163ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
43582025-05-22T21:20:35.163ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43592025-05-22T21:20:35.163ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43602025-05-22T21:20:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43612025-05-22T21:20:35.164ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43622025-05-22T21:20:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43632025-05-22T21:20:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43642025-05-22T21:20:35.167ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43652025-05-22T21:20:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43662025-05-22T21:20:35.172ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
43672025-05-22T21:20:35.172ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 86.152511ms iteration = 4 status = {"by_rx":{},"error":null}
43682025-05-22T21:20:35.173ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 88.934954ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
43692025-05-22T21:20:35.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
43702025-05-22T21:20:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43712025-05-22T21:20:35.174ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43722025-05-22T21:20:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43732025-05-22T21:20:35.183ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1144, tv_nsec: 326805811 } })
43742025-05-22T21:20:35.183ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
43752025-05-22T21:20:35.183ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43762025-05-22T21:20:35.183ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43772025-05-22T21:20:35.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43782025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43792025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43802025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43812025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43822025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43832025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43842025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43852025-05-22T21:20:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43862025-05-22T21:20:35.188ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43872025-05-22T21:20:35.190ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43882025-05-22T21:20:35.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43892025-05-22T21:20:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43902025-05-22T21:20:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
43912025-05-22T21:20:35.191ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
43922025-05-22T21:20:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
43932025-05-22T21:20:35.193ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43942025-05-22T21:20:35.193ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43952025-05-22T21:20:35.193ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43962025-05-22T21:20:35.193ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43972025-05-22T21:20:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43982025-05-22T21:20:35.194ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
43992025-05-22T21:20:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
44002025-05-22T21:20:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
44012025-05-22T21:20:35.196ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
44022025-05-22T21:20:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
44032025-05-22T21:20:35.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44042025-05-22T21:20:35.199ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44052025-05-22T21:20:35.199ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44062025-05-22T21:20:35.199ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 114.661675ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44072025-05-22T21:20:35.199ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44082025-05-22T21:20:35.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44092025-05-22T21:20:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44102025-05-22T21:20:35.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44112025-05-22T21:20:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
44122025-05-22T21:20:35.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44132025-05-22T21:20:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44142025-05-22T21:20:35.208ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44152025-05-22T21:20:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44162025-05-22T21:20:35.209ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 125.410065ms iteration = 4 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
44172025-05-22T21:20:35.210ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44182025-05-22T21:20:35.211ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44192025-05-22T21:20:35.211ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44202025-05-22T21:20:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44212025-05-22T21:20:35.214ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44222025-05-22T21:20:35.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44232025-05-22T21:20:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
44242025-05-22T21:20:35.215ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
44252025-05-22T21:20:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
44262025-05-22T21:20:35.216ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
44272025-05-22T21:20:35.220ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 136.293577ms iteration = 3 status = {"nsuccess":5}
44282025-05-22T21:20:35.229ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44292025-05-22T21:20:35.231ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
44302025-05-22T21:20:35.231ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 146.895365ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
44312025-05-22T21:20:35.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44322025-05-22T21:20:35.234ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44332025-05-22T21:20:35.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44342025-05-22T21:20:35.239ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352025-05-22T21:20:35.241ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44362025-05-22T21:20:35.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44372025-05-22T21:20:35.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44382025-05-22T21:20:35.242ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44392025-05-22T21:20:35.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44402025-05-22T21:20:35.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44412025-05-22T21:20:35.244ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44422025-05-22T21:20:35.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44432025-05-22T21:20:35.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
44442025-05-22T21:20:35.248ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
44452025-05-22T21:20:35.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
44462025-05-22T21:20:35.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 164.426766ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44472025-05-22T21:20:35.249ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
44482025-05-22T21:20:35.249ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 165.577553ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
44492025-05-22T21:20:35.253ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44502025-05-22T21:20:35.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44512025-05-22T21:20:35.256ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 171.984249ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44522025-05-22T21:20:35.261ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
44532025-05-22T21:20:35.261ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44542025-05-22T21:20:35.261ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a4b23a6-8fe5-4ecb-bfe4-14ff3d904b53", "content-length": "26", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
44552025-05-22T21:20:35.261ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44562025-05-22T21:20:35.264ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44572025-05-22T21:20:35.266ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
44582025-05-22T21:20:35.266ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
44592025-05-22T21:20:35.266ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
44602025-05-22T21:20:35.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44612025-05-22T21:20:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44622025-05-22T21:20:35.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44632025-05-22T21:20:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44642025-05-22T21:20:35.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
44652025-05-22T21:20:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
44662025-05-22T21:20:35.275ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44672025-05-22T21:20:35.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 191.324896ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44682025-05-22T21:20:35.278ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44692025-05-22T21:20:35.278ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
44702025-05-22T21:20:35.278ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 194.060107ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44712025-05-22T21:20:35.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
44722025-05-22T21:20:35.282ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
44732025-05-22T21:20:35.282ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44742025-05-22T21:20:35.282ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44752025-05-22T21:20:35.282ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 198.083537ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44762025-05-22T21:20:35.283ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4ea4766-6c16-4d27-ad85-074f6acbae24", "content-length": "26", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
44772025-05-22T21:20:35.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
44782025-05-22T21:20:35.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
44792025-05-22T21:20:35.299ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44802025-05-22T21:20:35.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44812025-05-22T21:20:35.301ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44822025-05-22T21:20:35.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 220.300767ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
44832025-05-22T21:20:35.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44842025-05-22T21:20:35.305ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44852025-05-22T21:20:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44862025-05-22T21:20:35.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44872025-05-22T21:20:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44882025-05-22T21:20:35.317ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44892025-05-22T21:20:35.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44902025-05-22T21:20:35.320ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44912025-05-22T21:20:35.321ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44922025-05-22T21:20:35.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44932025-05-22T21:20:35.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44942025-05-22T21:20:35.324ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44952025-05-22T21:20:35.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
44962025-05-22T21:20:35.329ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44972025-05-22T21:20:35.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44982025-05-22T21:20:35.335ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 250.71047ms iteration = 7 status = 0
44992025-05-22T21:20:35.335ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45002025-05-22T21:20:35.335ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45012025-05-22T21:20:35.335ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45022025-05-22T21:20:35.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45032025-05-22T21:20:35.337ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45042025-05-22T21:20:35.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
45052025-05-22T21:20:35.340ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45062025-05-22T21:20:35.340ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d40f56e-e1a0-4e76-82fc-e190920fb777", "content-length": "26", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
45072025-05-22T21:20:35.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45082025-05-22T21:20:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45092025-05-22T21:20:35.342ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45102025-05-22T21:20:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45112025-05-22T21:20:35.342ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45122025-05-22T21:20:35.343ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
45132025-05-22T21:20:35.345ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
45142025-05-22T21:20:35.345ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45152025-05-22T21:20:35.345ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
45162025-05-22T21:20:35.345ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 260.619357ms iteration = 4 status = {"generation":1}
45172025-05-22T21:20:35.358ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
45182025-05-22T21:20:35.358ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 274.19717ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45192025-05-22T21:20:35.363ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 279.478548ms iteration = 9 status = {"physical_disks_added":0}
45202025-05-22T21:20:35.381ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45212025-05-22T21:20:35.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "5176bab4-4c7d-4a83-bdad-a037a713b57a", "date": "Thu, 22 May 2025 21:20:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45222025-05-22T21:20:35.382ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45232025-05-22T21:20:35.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "43139fd0-4229-4127-8a76-0b2642e7715b", "date": "Thu, 22 May 2025 21:20:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45242025-05-22T21:20:35.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45252025-05-22T21:20:35.385ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45262025-05-22T21:20:35.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 300.522721ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45272025-05-22T21:20:35.399ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
45282025-05-22T21:20:35.399ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
45292025-05-22T21:20:35.399ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
45302025-05-22T21:20:35.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45312025-05-22T21:20:35.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45322025-05-22T21:20:35.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45332025-05-22T21:20:35.405ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45342025-05-22T21:20:35.406ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45352025-05-22T21:20:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45362025-05-22T21:20:35.419ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45372025-05-22T21:20:35.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45382025-05-22T21:20:35.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45392025-05-22T21:20:35.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45402025-05-22T21:20:35.448ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 363.53529ms iteration = 7 status = {}
45412025-05-22T21:20:35.458ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45422025-05-22T21:20:35.458ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "dc663c7c-b18f-4a5f-95c0-4fcf5d0be85d", "date": "Thu, 22 May 2025 21:20:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45432025-05-22T21:20:35.458ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45442025-05-22T21:20:35.459ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "00e4d681-1b69-4a67-aae7-ac3affbf97e9", "date": "Thu, 22 May 2025 21:20:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45452025-05-22T21:20:35.459ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45462025-05-22T21:20:35.461ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3f55b6ef-505e-4037-aa3a-cfb8b54ab605", "date": "Thu, 22 May 2025 21:20:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45472025-05-22T21:20:35.462ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45482025-05-22T21:20:35.464ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
45492025-05-22T21:20:35.464ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 379.681849ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
45502025-05-22T21:20:35.471ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
45512025-05-22T21:20:35.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 386.42876ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45522025-05-22T21:20:35.474ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45532025-05-22T21:20:35.474ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45542025-05-22T21:20:35.474ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e29aa833-277b-4182-bb08-520634bba3b9", "content-length": "372", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
45552025-05-22T21:20:35.474ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45562025-05-22T21:20:35.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45572025-05-22T21:20:35.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45582025-05-22T21:20:35.476ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 391.659738ms iteration = 7 status = null
45592025-05-22T21:20:35.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45602025-05-22T21:20:35.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45612025-05-22T21:20:35.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45622025-05-22T21:20:35.484ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632025-05-22T21:20:35.488ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45642025-05-22T21:20:35.488ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652025-05-22T21:20:35.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662025-05-22T21:20:35.515ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
45672025-05-22T21:20:35.515ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
45682025-05-22T21:20:35.515ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45692025-05-22T21:20:35.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45702025-05-22T21:20:35.533ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45712025-05-22T21:20:35.533ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45722025-05-22T21:20:35.533ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5c9cd3df-bf6f-4560-bbc3-79e9d00860d2", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
45732025-05-22T21:20:35.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45742025-05-22T21:20:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45752025-05-22T21:20:35.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37724caa-1563-40a2-81de-b0e7d3f3f0fd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
45762025-05-22T21:20:35.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37724caa-1563-40a2-81de-b0e7d3f3f0fd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
45772025-05-22T21:20:35.541ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45782025-05-22T21:20:35.542ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcaea9c3-f753-464d-b16b-f00d46b8cdbb", "content-length": "691", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
45792025-05-22T21:20:35.542ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45802025-05-22T21:20:35.542ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45812025-05-22T21:20:35.542ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45822025-05-22T21:20:35.543ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45832025-05-22T21:20:35.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 5992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37724caa-1563-40a2-81de-b0e7d3f3f0fd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
45842025-05-22T21:20:35.544ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 460.275678ms iteration = 7 status = {}
45852025-05-22T21:20:35.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45862025-05-22T21:20:35.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45872025-05-22T21:20:35.553ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45882025-05-22T21:20:35.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45892025-05-22T21:20:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
45902025-05-22T21:20:35.554ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45912025-05-22T21:20:35.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45922025-05-22T21:20:35.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45932025-05-22T21:20:35.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45942025-05-22T21:20:35.556ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45952025-05-22T21:20:35.556ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45962025-05-22T21:20:35.557ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "03a78e6a-7c4c-4b13-95a2-99544aa6a5f5", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
45972025-05-22T21:20:35.558ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
45982025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45992025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
46002025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
46012025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
46022025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 474.081854ms iteration = 4 status = {"generation":2}
46032025-05-22T21:20:35.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46042025-05-22T21:20:35.559ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 474.513351ms iteration = 7 status = {}
46052025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46062025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
46072025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46082025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46092025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46102025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46112025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46122025-05-22T21:20:35.574ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46132025-05-22T21:20:35.575ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46142025-05-22T21:20:35.575ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46152025-05-22T21:20:35.575ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
46162025-05-22T21:20:35.575ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46172025-05-22T21:20:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46182025-05-22T21:20:35.578ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
46192025-05-22T21:20:35.578ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46202025-05-22T21:20:35.802ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "06951bbb-6d0f-4b9c-952f-b118c47fe487", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
46212025-05-22T21:20:35.803ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
46222025-05-22T21:20:35.803ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46232025-05-22T21:20:35.803ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8217791d-1d34-4ba3-97c1-baee0b4a33c6", "content-length": "682", "date": "Thu, 22 May 2025 21:20:35 GMT"} })
46242025-05-22T21:20:35.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46252025-05-22T21:20:35.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46262025-05-22T21:20:35.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46272025-05-22T21:20:35.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46282025-05-22T21:20:35.811ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46292025-05-22T21:20:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46302025-05-22T21:20:35.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46312025-05-22T21:20:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46322025-05-22T21:20:35.820ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 736.317087ms iteration = 7 status = {}
46332025-05-22T21:20:36.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcbb95a9-1e98-400a-b334-f665f7ecfc08 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46342025-05-22T21:20:36.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcbb95a9-1e98-400a-b334-f665f7ecfc08 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46352025-05-22T21:20:36.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcbb95a9-1e98-400a-b334-f665f7ecfc08 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46362025-05-22T21:20:37.577ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00ba79de-4789-4699-ba7f-8e4e90447d54 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46372025-05-22T21:20:37.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00ba79de-4789-4699-ba7f-8e4e90447d54 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46382025-05-22T21:20:37.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00ba79de-4789-4699-ba7f-8e4e90447d54 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46392025-05-22T21:20:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 485 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 3a315195-235c-4682-8662-a0b0b5b91dbd response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
46402025-05-22T21:20:38.593ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5717e423-87b3-4da0-a831-e4ba0ac46575 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46412025-05-22T21:20:38.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5717e423-87b3-4da0-a831-e4ba0ac46575 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46422025-05-22T21:20:38.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2850 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5717e423-87b3-4da0-a831-e4ba0ac46575 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46432025-05-22T21:20:39.610ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7bdacce-9f60-455f-92ca-9c1bac34412e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46442025-05-22T21:20:39.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7bdacce-9f60-455f-92ca-9c1bac34412e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46452025-05-22T21:20:39.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7bdacce-9f60-455f-92ca-9c1bac34412e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46462025-05-22T21:20:40.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67cef678-014e-477a-8d27-d3cfc6fa7222 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46472025-05-22T21:20:40.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67cef678-014e-477a-8d27-d3cfc6fa7222 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46482025-05-22T21:20:40.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67cef678-014e-477a-8d27-d3cfc6fa7222 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46492025-05-22T21:20:41.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d661557-5bae-4d7a-be0d-bca7e9e98b1c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46502025-05-22T21:20:41.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d661557-5bae-4d7a-be0d-bca7e9e98b1c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46512025-05-22T21:20:41.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2654 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d661557-5bae-4d7a-be0d-bca7e9e98b1c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46522025-05-22T21:20:42.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5a602f7b-7a03-4e4c-980e-f53643f47ef9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46532025-05-22T21:20:42.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5a602f7b-7a03-4e4c-980e-f53643f47ef9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46542025-05-22T21:20:42.660ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2388 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5a602f7b-7a03-4e4c-980e-f53643f47ef9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46552025-05-22T21:20:43.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 51ae3b77-178a-40fe-95b2-7caf24c13e30 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46562025-05-22T21:20:43.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 51ae3b77-178a-40fe-95b2-7caf24c13e30 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46572025-05-22T21:20:43.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 51ae3b77-178a-40fe-95b2-7caf24c13e30 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46582025-05-22T21:20:44.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3292989-241a-491c-ad29-994b9601414b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46592025-05-22T21:20:44.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3292989-241a-491c-ad29-994b9601414b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46602025-05-22T21:20:44.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3292989-241a-491c-ad29-994b9601414b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46612025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
46622025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
46632025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46642025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46652025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46662025-05-22T21:20:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46672025-05-22T21:20:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46682025-05-22T21:20:45.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46692025-05-22T21:20:45.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46702025-05-22T21:20:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46712025-05-22T21:20:45.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46722025-05-22T21:20:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46732025-05-22T21:20:45.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46742025-05-22T21:20:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46752025-05-22T21:20:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46762025-05-22T21:20:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
46772025-05-22T21:20:45.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46782025-05-22T21:20:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46792025-05-22T21:20:45.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
46802025-05-22T21:20:45.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.579616ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
46812025-05-22T21:20:45.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.853279ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46822025-05-22T21:20:45.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b01100af-34d7-429d-8dbf-a3c6b5b9341f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46832025-05-22T21:20:45.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b01100af-34d7-429d-8dbf-a3c6b5b9341f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46842025-05-22T21:20:45.710ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b01100af-34d7-429d-8dbf-a3c6b5b9341f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46852025-05-22T21:20:46.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bab258e5-32e3-4e8d-8e55-b53ebb780801 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46862025-05-22T21:20:46.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bab258e5-32e3-4e8d-8e55-b53ebb780801 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46872025-05-22T21:20:46.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bab258e5-32e3-4e8d-8e55-b53ebb780801 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46882025-05-22T21:20:47.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 256fe15d-bbcc-4887-bccc-196c46c1ba93 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46892025-05-22T21:20:47.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 256fe15d-bbcc-4887-bccc-196c46c1ba93 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46902025-05-22T21:20:47.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 256fe15d-bbcc-4887-bccc-196c46c1ba93 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46912025-05-22T21:20:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 465 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = c081a747-7cb0-41d6-b99f-1f63ac4cf222 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
46922025-05-22T21:20:48.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1492e7f8-57c5-4983-93b6-4e5e9a3af830 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46932025-05-22T21:20:48.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1492e7f8-57c5-4983-93b6-4e5e9a3af830 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46942025-05-22T21:20:48.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1492e7f8-57c5-4983-93b6-4e5e9a3af830 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46952025-05-22T21:20:49.771ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92b083fb-2444-4526-81a3-a71fe911623f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46962025-05-22T21:20:49.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92b083fb-2444-4526-81a3-a71fe911623f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46972025-05-22T21:20:49.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1787 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92b083fb-2444-4526-81a3-a71fe911623f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46982025-05-22T21:20:50.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3c7df3b6-226a-43da-8ccf-38bcef645386 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
46992025-05-22T21:20:50.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3c7df3b6-226a-43da-8ccf-38bcef645386 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47002025-05-22T21:20:50.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2706 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3c7df3b6-226a-43da-8ccf-38bcef645386 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47012025-05-22T21:20:51.803ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c87473bb-0894-4b45-b825-b37ebfac6c32 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47022025-05-22T21:20:51.803ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c87473bb-0894-4b45-b825-b37ebfac6c32 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47032025-05-22T21:20:51.805ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c87473bb-0894-4b45-b825-b37ebfac6c32 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47042025-05-22T21:20:52.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3aacbc85-0883-472f-9b49-7612ca741cb0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47052025-05-22T21:20:52.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3aacbc85-0883-472f-9b49-7612ca741cb0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47062025-05-22T21:20:52.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3aacbc85-0883-472f-9b49-7612ca741cb0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47072025-05-22T21:20:53.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d2b06047-2452-490f-9e32-809b3b8b9650 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47082025-05-22T21:20:53.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d2b06047-2452-490f-9e32-809b3b8b9650 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47092025-05-22T21:20:53.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d2b06047-2452-490f-9e32-809b3b8b9650 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47102025-05-22T21:20:54.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8278e00-eea6-429f-aa6d-0c9cfc400583 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47112025-05-22T21:20:54.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8278e00-eea6-429f-aa6d-0c9cfc400583 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47122025-05-22T21:20:54.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8278e00-eea6-429f-aa6d-0c9cfc400583 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47132025-05-22T21:20:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
47142025-05-22T21:20:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
47152025-05-22T21:20:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47162025-05-22T21:20:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47172025-05-22T21:20:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47182025-05-22T21:20:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47192025-05-22T21:20:55.118ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47202025-05-22T21:20:55.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47212025-05-22T21:20:55.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222025-05-22T21:20:55.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47232025-05-22T21:20:55.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47242025-05-22T21:20:55.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47252025-05-22T21:20:55.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47262025-05-22T21:20:55.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47272025-05-22T21:20:55.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47282025-05-22T21:20:55.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
47292025-05-22T21:20:55.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47302025-05-22T21:20:55.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47312025-05-22T21:20:55.145ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
47322025-05-22T21:20:55.145ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.400239ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
47332025-05-22T21:20:55.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.54143ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47342025-05-22T21:20:55.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7e435a7-36c6-4231-ad51-edcc8cce3dc5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47352025-05-22T21:20:55.865ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7e435a7-36c6-4231-ad51-edcc8cce3dc5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47362025-05-22T21:20:55.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7e435a7-36c6-4231-ad51-edcc8cce3dc5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47372025-05-22T21:20:56.881ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e20a83f5-1697-47d9-8f80-7fa47b15cca2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47382025-05-22T21:20:56.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e20a83f5-1697-47d9-8f80-7fa47b15cca2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47392025-05-22T21:20:56.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e20a83f5-1697-47d9-8f80-7fa47b15cca2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47402025-05-22T21:20:57.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4ccc31a-130b-4a60-89dd-54a26d887782 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47412025-05-22T21:20:57.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4ccc31a-130b-4a60-89dd-54a26d887782 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47422025-05-22T21:20:57.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4ccc31a-130b-4a60-89dd-54a26d887782 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47432025-05-22T21:20:58.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 701 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = d1fb0a0f-5aa1-41d2-9ce4-1b1e20071aba response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
47442025-05-22T21:20:58.912ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cde208ee-9a2d-4f7d-bccf-bec1da65f3d7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47452025-05-22T21:20:58.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cde208ee-9a2d-4f7d-bccf-bec1da65f3d7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47462025-05-22T21:20:58.914ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cde208ee-9a2d-4f7d-bccf-bec1da65f3d7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47472025-05-22T21:20:59.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2832f5a8-5bb2-4710-831f-e8b022b0b4e1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47482025-05-22T21:20:59.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2832f5a8-5bb2-4710-831f-e8b022b0b4e1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47492025-05-22T21:20:59.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2832f5a8-5bb2-4710-831f-e8b022b0b4e1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47502025-05-22T21:21:00.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 249a413f-bfbc-4a1a-ab7a-9252ebe0588f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47512025-05-22T21:21:00.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 249a413f-bfbc-4a1a-ab7a-9252ebe0588f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47522025-05-22T21:21:00.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 249a413f-bfbc-4a1a-ab7a-9252ebe0588f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47532025-05-22T21:21:01.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 581b9913-f4de-40c6-b3d3-35865f7c403d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47542025-05-22T21:21:01.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 581b9913-f4de-40c6-b3d3-35865f7c403d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47552025-05-22T21:21:01.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 581b9913-f4de-40c6-b3d3-35865f7c403d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47562025-05-22T21:21:02.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a625244-fac5-4d01-b661-1695488653c6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47572025-05-22T21:21:02.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a625244-fac5-4d01-b661-1695488653c6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47582025-05-22T21:21:02.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a625244-fac5-4d01-b661-1695488653c6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47592025-05-22T21:21:03.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97caa219-da97-4db0-966c-6124378cc7ff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47602025-05-22T21:21:03.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97caa219-da97-4db0-966c-6124378cc7ff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47612025-05-22T21:21:03.993ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1974 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97caa219-da97-4db0-966c-6124378cc7ff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47622025-05-22T21:21:05.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34dec530-f252-4a3b-82c1-5c6c9ea6bacf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47632025-05-22T21:21:05.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34dec530-f252-4a3b-82c1-5c6c9ea6bacf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47642025-05-22T21:21:05.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34dec530-f252-4a3b-82c1-5c6c9ea6bacf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
47652025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
47662025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
47672025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47682025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47692025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47702025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
47712025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47722025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
47732025-05-22T21:21:05.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47742025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
47752025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47762025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
47772025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47782025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
47792025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47802025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47812025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
47822025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
47832025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47842025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
47852025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47862025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47872025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
47882025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47892025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
47902025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
47912025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47922025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
47932025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
47942025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47952025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
47962025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47972025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47982025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
47992025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48002025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
48012025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48022025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
48032025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
48042025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48052025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48062025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48072025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48082025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48092025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48102025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48112025-05-22T21:21:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48122025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48132025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
48142025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48152025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
48162025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48172025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48182025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48192025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48202025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
48212025-05-22T21:21:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
48222025-05-22T21:21:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48232025-05-22T21:21:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48242025-05-22T21:21:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.456787ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
48252025-05-22T21:21:05.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48262025-05-22T21:21:05.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 232917321 } })
48272025-05-22T21:21:05.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
48282025-05-22T21:21:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48292025-05-22T21:21:05.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48302025-05-22T21:21:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48312025-05-22T21:21:05.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48322025-05-22T21:21:05.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48332025-05-22T21:21:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
48342025-05-22T21:21:05.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48352025-05-22T21:21:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48362025-05-22T21:21:05.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 241366247 } })
48372025-05-22T21:21:05.098ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
48382025-05-22T21:21:05.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48392025-05-22T21:21:05.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48402025-05-22T21:21:05.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48412025-05-22T21:21:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48422025-05-22T21:21:05.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48432025-05-22T21:21:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
48442025-05-22T21:21:05.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48452025-05-22T21:21:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48462025-05-22T21:21:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
48472025-05-22T21:21:05.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48482025-05-22T21:21:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48492025-05-22T21:21:05.106ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 22.295801ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
48502025-05-22T21:21:05.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48512025-05-22T21:21:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
48522025-05-22T21:21:05.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
48532025-05-22T21:21:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
48542025-05-22T21:21:05.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48552025-05-22T21:21:05.115ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1174, tv_nsec: 259645199 } })
48562025-05-22T21:21:05.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
48572025-05-22T21:21:05.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48582025-05-22T21:21:05.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48592025-05-22T21:21:05.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
48602025-05-22T21:21:05.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48612025-05-22T21:21:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48622025-05-22T21:21:05.121ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
48632025-05-22T21:21:05.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48642025-05-22T21:21:05.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48652025-05-22T21:21:05.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
48662025-05-22T21:21:05.148ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48672025-05-22T21:21:05.148ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48682025-05-22T21:21:05.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48692025-05-22T21:21:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48702025-05-22T21:21:05.152ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48712025-05-22T21:21:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48722025-05-22T21:21:05.154ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48732025-05-22T21:21:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 70.794614ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48742025-05-22T21:21:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48752025-05-22T21:21:05.157ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48762025-05-22T21:21:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48772025-05-22T21:21:05.161ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48782025-05-22T21:21:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48792025-05-22T21:21:05.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48802025-05-22T21:21:05.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48812025-05-22T21:21:05.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.129272ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
48822025-05-22T21:21:05.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48832025-05-22T21:21:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48842025-05-22T21:21:05.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48852025-05-22T21:21:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48862025-05-22T21:21:05.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48872025-05-22T21:21:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
48882025-05-22T21:21:05.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48892025-05-22T21:21:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48902025-05-22T21:21:05.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.798496ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48912025-05-22T21:21:05.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48922025-05-22T21:21:05.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48932025-05-22T21:21:05.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48942025-05-22T21:21:05.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48952025-05-22T21:21:05.178ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
48962025-05-22T21:21:05.178ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48972025-05-22T21:21:05.178ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5d79102-37eb-4002-a99a-efead91e0a61", "content-length": "26", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
48982025-05-22T21:21:05.178ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48992025-05-22T21:21:05.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49002025-05-22T21:21:05.179ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.3982ms iteration = 8 status = 0
49012025-05-22T21:21:05.180ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49022025-05-22T21:21:05.180ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
49032025-05-22T21:21:05.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49042025-05-22T21:21:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
49052025-05-22T21:21:05.183ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 98.674868ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
49062025-05-22T21:21:05.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49072025-05-22T21:21:05.183ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49082025-05-22T21:21:05.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49092025-05-22T21:21:05.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
49102025-05-22T21:21:05.184ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
49112025-05-22T21:21:05.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49122025-05-22T21:21:05.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
49132025-05-22T21:21:05.185ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
49142025-05-22T21:21:05.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 100.586676ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
49152025-05-22T21:21:05.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
49162025-05-22T21:21:05.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49172025-05-22T21:21:05.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49182025-05-22T21:21:05.205ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49192025-05-22T21:21:05.205ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
49202025-05-22T21:21:05.205ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49212025-05-22T21:21:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49222025-05-22T21:21:05.209ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
49232025-05-22T21:21:05.209ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49242025-05-22T21:21:05.209ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ecef4157-c751-4e83-a039-d406f7112f4c", "content-length": "26", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49252025-05-22T21:21:05.209ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49262025-05-22T21:21:05.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
49272025-05-22T21:21:05.210ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
49282025-05-22T21:21:05.210ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "db51ddc3-4a56-40a9-adf3-287e1655b075", "content-length": "26", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49292025-05-22T21:21:05.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
49302025-05-22T21:21:05.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
49312025-05-22T21:21:05.211ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
49322025-05-22T21:21:05.216ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
49332025-05-22T21:21:05.216ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.297119ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
49342025-05-22T21:21:05.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 139.85976ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
49352025-05-22T21:21:05.230ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 145.87976ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
49362025-05-22T21:21:05.232ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
49372025-05-22T21:21:05.232ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 148.069692ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
49382025-05-22T21:21:05.248ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
49392025-05-22T21:21:05.248ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
49402025-05-22T21:21:05.248ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 164.392816ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
49412025-05-22T21:21:05.250ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49422025-05-22T21:21:05.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49432025-05-22T21:21:05.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 168.439126ms iteration = 8 status = null
49442025-05-22T21:21:05.279ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.311896ms iteration = 8 status = {}
49452025-05-22T21:21:05.284ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
49462025-05-22T21:21:05.284ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49472025-05-22T21:21:05.284ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe849a18-ae52-4ee9-a9f1-1a5cb6b6ec6b", "content-length": "372", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49482025-05-22T21:21:05.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49492025-05-22T21:21:05.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49502025-05-22T21:21:05.295ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49512025-05-22T21:21:05.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49522025-05-22T21:21:05.297ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49532025-05-22T21:21:05.299ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49542025-05-22T21:21:05.299ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49552025-05-22T21:21:05.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49562025-05-22T21:21:05.302ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 218.186186ms iteration = 10 status = {"physical_disks_added":0}
49572025-05-22T21:21:05.328ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
49582025-05-22T21:21:05.328ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
49592025-05-22T21:21:05.328ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "74b92204-9e90-4e38-9dbe-a86b071852ab", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49602025-05-22T21:21:05.328ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49612025-05-22T21:21:05.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49622025-05-22T21:21:05.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49632025-05-22T21:21:05.331ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49642025-05-22T21:21:05.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49652025-05-22T21:21:05.332ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
49662025-05-22T21:21:05.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49672025-05-22T21:21:05.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49682025-05-22T21:21:05.334ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49692025-05-22T21:21:05.334ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49702025-05-22T21:21:05.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49712025-05-22T21:21:05.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49722025-05-22T21:21:05.336ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
49732025-05-22T21:21:05.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49742025-05-22T21:21:05.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49752025-05-22T21:21:05.338ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49762025-05-22T21:21:05.338ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49772025-05-22T21:21:05.338ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e5f4267b-60f8-4f54-995a-145ce78a0c91", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49782025-05-22T21:21:05.342ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 258.431935ms iteration = 8 status = {}
49792025-05-22T21:21:05.351ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
49802025-05-22T21:21:05.351ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
49812025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49822025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49832025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49842025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49852025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49862025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49872025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49882025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49892025-05-22T21:21:05.352ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
49902025-05-22T21:21:05.352ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49912025-05-22T21:21:05.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49922025-05-22T21:21:05.355ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
49932025-05-22T21:21:05.355ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49942025-05-22T21:21:05.429ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49952025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4702ee35-460d-4fb6-84e8-fa52dfb5c452", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49962025-05-22T21:21:05.454ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
49972025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49982025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e80f9b69-4da5-4289-8a9d-c06ab6c4b14d", "content-length": "691", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
49992025-05-22T21:21:05.454ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
50002025-05-22T21:21:05.454ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
50012025-05-22T21:21:05.454ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
50022025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9074501f-7bdb-4b9e-86a5-39d2be682f00", "content-length": "682", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
50032025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50042025-05-22T21:21:05.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50052025-05-22T21:21:05.455ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 370.828268ms iteration = 8 status = {}
50062025-05-22T21:21:05.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50072025-05-22T21:21:05.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50082025-05-22T21:21:05.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50092025-05-22T21:21:05.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50102025-05-22T21:21:05.464ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50112025-05-22T21:21:05.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50122025-05-22T21:21:05.471ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 387.255813ms iteration = 8 status = {}
50132025-05-22T21:21:05.747ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 1
50142025-05-22T21:21:05.747ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
50152025-05-22T21:21:05.776ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
50162025-05-22T21:21:05.776ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:38349
50172025-05-22T21:21:05.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38349 req_id = 6b2b556e-0cbc-47b8-85b2-2ff0111b242e roles = RoleSet { roles: {} } uri = /metrics/producers
50182025-05-22T21:21:05.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38349 req_id = 6b2b556e-0cbc-47b8-85b2-2ff0111b242e resource = Database result = Ok(()) uri = /metrics/producers
50192025-05-22T21:21:05.821ZINFOnexus: assigned collector to new producer collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 file = nexus/src/app/oximeter.rs:76 producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
50202025-05-22T21:21:05.821ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 44361 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:38349 req_id = 6b2b556e-0cbc-47b8-85b2-2ff0111b242e response_code = 201 uri = /metrics/producers
50212025-05-22T21:21:05.821ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "6b2b556e-0cbc-47b8-85b2-2ff0111b242e", "content-length": "41", "date": "Thu, 22 May 2025 21:21:05 GMT"} })
50222025-05-22T21:21:05.822ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
50232025-05-22T21:21:06.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a90c15-c101-4a03-97b5-40d5460f3a4b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50242025-05-22T21:21:06.022ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a90c15-c101-4a03-97b5-40d5460f3a4b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50252025-05-22T21:21:06.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a90c15-c101-4a03-97b5-40d5460f3a4b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50262025-05-22T21:21:07.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b208ee5d-1717-4751-8aae-4185199c7930 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50272025-05-22T21:21:07.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b208ee5d-1717-4751-8aae-4185199c7930 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50282025-05-22T21:21:07.040ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b208ee5d-1717-4751-8aae-4185199c7930 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50292025-05-22T21:21:08.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cd6a8e63-ea17-4dda-a8ed-cf508fa37b3d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50302025-05-22T21:21:08.053ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cd6a8e63-ea17-4dda-a8ed-cf508fa37b3d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50312025-05-22T21:21:08.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cd6a8e63-ea17-4dda-a8ed-cf508fa37b3d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50322025-05-22T21:21:08.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 791 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 8b48d7a4-5b3d-47e5-8d09-e22cde6f5f23 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
50332025-05-22T21:21:09.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 47faec00-8786-4aa4-9365-d9f857b6821d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50342025-05-22T21:21:09.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 47faec00-8786-4aa4-9365-d9f857b6821d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50352025-05-22T21:21:09.071ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 47faec00-8786-4aa4-9365-d9f857b6821d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50362025-05-22T21:21:10.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5dbc8085-1911-45b3-923a-e2070618ca34 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50372025-05-22T21:21:10.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5dbc8085-1911-45b3-923a-e2070618ca34 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50382025-05-22T21:21:10.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5dbc8085-1911-45b3-923a-e2070618ca34 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50392025-05-22T21:21:11.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 592dbc2b-01c0-4847-a6be-4174e14a3126 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50402025-05-22T21:21:11.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 592dbc2b-01c0-4847-a6be-4174e14a3126 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50412025-05-22T21:21:11.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 592dbc2b-01c0-4847-a6be-4174e14a3126 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50422025-05-22T21:21:12.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3fc6754-dbfb-4484-8f01-e02855186fa1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50432025-05-22T21:21:12.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3fc6754-dbfb-4484-8f01-e02855186fa1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50442025-05-22T21:21:12.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3160 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3fc6754-dbfb-4484-8f01-e02855186fa1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50452025-05-22T21:21:13.132ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb98972d-62d6-4e69-b0c3-534fa9f8bfa1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50462025-05-22T21:21:13.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb98972d-62d6-4e69-b0c3-534fa9f8bfa1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50472025-05-22T21:21:13.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb98972d-62d6-4e69-b0c3-534fa9f8bfa1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50482025-05-22T21:21:14.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0fd5687-f415-4fb9-94a7-150625ed1dcf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50492025-05-22T21:21:14.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0fd5687-f415-4fb9-94a7-150625ed1dcf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50502025-05-22T21:21:14.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0fd5687-f415-4fb9-94a7-150625ed1dcf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50512025-05-22T21:21:15.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
50522025-05-22T21:21:15.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50532025-05-22T21:21:15.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
50542025-05-22T21:21:15.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50552025-05-22T21:21:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50562025-05-22T21:21:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50572025-05-22T21:21:15.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50582025-05-22T21:21:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50592025-05-22T21:21:15.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50602025-05-22T21:21:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50612025-05-22T21:21:15.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50622025-05-22T21:21:15.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50632025-05-22T21:21:15.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50642025-05-22T21:21:15.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
50652025-05-22T21:21:15.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50662025-05-22T21:21:15.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50672025-05-22T21:21:15.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
50682025-05-22T21:21:15.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.668748ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
50692025-05-22T21:21:15.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50702025-05-22T21:21:15.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50712025-05-22T21:21:15.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.199099ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50722025-05-22T21:21:15.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1987595f-85d6-4b56-b128-32998852db47 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50732025-05-22T21:21:15.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1987595f-85d6-4b56-b128-32998852db47 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50742025-05-22T21:21:15.164ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1987595f-85d6-4b56-b128-32998852db47 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50752025-05-22T21:21:16.177ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6bec0c57-2781-430d-b421-850ac4ab4311 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50762025-05-22T21:21:16.177ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6bec0c57-2781-430d-b421-850ac4ab4311 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50772025-05-22T21:21:16.179ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1861 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6bec0c57-2781-430d-b421-850ac4ab4311 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50782025-05-22T21:21:17.193ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18012200-e4f1-4745-ac0c-717e1e2f078f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50792025-05-22T21:21:17.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18012200-e4f1-4745-ac0c-717e1e2f078f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50802025-05-22T21:21:17.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1809 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 18012200-e4f1-4745-ac0c-717e1e2f078f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50812025-05-22T21:21:18.152ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:43477
50822025-05-22T21:21:18.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = f652085b-bfab-4778-97ea-215ca2642dfd roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
50832025-05-22T21:21:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = f652085b-bfab-4778-97ea-215ca2642dfd resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
50842025-05-22T21:21:18.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = f652085b-bfab-4778-97ea-215ca2642dfd response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
50852025-05-22T21:21:18.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = df434482-0ee8-403e-825c-525678b9391b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
50862025-05-22T21:21:18.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = df434482-0ee8-403e-825c-525678b9391b resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
50872025-05-22T21:21:18.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2676 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:43477 req_id = df434482-0ee8-403e-825c-525678b9391b response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
50882025-05-22T21:21:18.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 475 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 857d1649-d0a0-4c08-a1ab-5c9cc27ea8c6 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
50892025-05-22T21:21:18.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41e7face-1995-4ed8-a603-0f84f141f623 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50902025-05-22T21:21:18.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41e7face-1995-4ed8-a603-0f84f141f623 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50912025-05-22T21:21:18.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2008 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41e7face-1995-4ed8-a603-0f84f141f623 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50922025-05-22T21:21:19.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e48ea9e-c5c6-4813-a741-df5cec9dabc5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50932025-05-22T21:21:19.225ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e48ea9e-c5c6-4813-a741-df5cec9dabc5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50942025-05-22T21:21:19.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e48ea9e-c5c6-4813-a741-df5cec9dabc5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50952025-05-22T21:21:20.240ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d25391d-5b03-4684-ae0b-100649634f8d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50962025-05-22T21:21:20.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d25391d-5b03-4684-ae0b-100649634f8d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50972025-05-22T21:21:20.243ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d25391d-5b03-4684-ae0b-100649634f8d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50982025-05-22T21:21:21.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e8ebe2a6-723b-41e2-89be-a6314bf5f0b8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
50992025-05-22T21:21:21.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e8ebe2a6-723b-41e2-89be-a6314bf5f0b8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51002025-05-22T21:21:21.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2320 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e8ebe2a6-723b-41e2-89be-a6314bf5f0b8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51012025-05-22T21:21:22.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1572949-5127-4346-a12f-0e06bcd8d217 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51022025-05-22T21:21:22.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1572949-5127-4346-a12f-0e06bcd8d217 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51032025-05-22T21:21:22.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1572949-5127-4346-a12f-0e06bcd8d217 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51042025-05-22T21:21:23.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a77fc261-73a4-44ab-948e-12334a1d7ead roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51052025-05-22T21:21:23.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a77fc261-73a4-44ab-948e-12334a1d7ead resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51062025-05-22T21:21:23.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a77fc261-73a4-44ab-948e-12334a1d7ead response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51072025-05-22T21:21:24.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16ad9708-972e-452e-88e3-8dda0ef026fa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51082025-05-22T21:21:24.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16ad9708-972e-452e-88e3-8dda0ef026fa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51092025-05-22T21:21:24.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1835 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16ad9708-972e-452e-88e3-8dda0ef026fa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51102025-05-22T21:21:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
51112025-05-22T21:21:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51122025-05-22T21:21:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
51132025-05-22T21:21:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51142025-05-22T21:21:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51152025-05-22T21:21:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51162025-05-22T21:21:25.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51172025-05-22T21:21:25.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51182025-05-22T21:21:25.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51192025-05-22T21:21:25.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.185347ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51202025-05-22T21:21:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51212025-05-22T21:21:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51222025-05-22T21:21:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51232025-05-22T21:21:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51242025-05-22T21:21:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51252025-05-22T21:21:25.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51262025-05-22T21:21:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
51272025-05-22T21:21:25.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51282025-05-22T21:21:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51292025-05-22T21:21:25.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
51302025-05-22T21:21:25.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.655582ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
51312025-05-22T21:21:25.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9bf2391-15ae-4792-8ccf-f17a2ca46a98 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51322025-05-22T21:21:25.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9bf2391-15ae-4792-8ccf-f17a2ca46a98 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51332025-05-22T21:21:25.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9bf2391-15ae-4792-8ccf-f17a2ca46a98 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51342025-05-22T21:21:26.335ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9ddff1-3045-4871-add9-dca367a82c2b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51352025-05-22T21:21:26.335ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9ddff1-3045-4871-add9-dca367a82c2b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51362025-05-22T21:21:26.337ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2073 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9ddff1-3045-4871-add9-dca367a82c2b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51372025-05-22T21:21:27.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 847bded4-63e8-4b2f-ad54-347f8ecc8a6e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51382025-05-22T21:21:27.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 847bded4-63e8-4b2f-ad54-347f8ecc8a6e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51392025-05-22T21:21:27.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 847bded4-63e8-4b2f-ad54-347f8ecc8a6e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51402025-05-22T21:21:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 552 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = d2a449a5-d178-4c55-987c-5215f0811652 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
51412025-05-22T21:21:28.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6795ab45-1e5a-48ea-bbff-49c6ecd5232f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51422025-05-22T21:21:28.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6795ab45-1e5a-48ea-bbff-49c6ecd5232f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51432025-05-22T21:21:28.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2090 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6795ab45-1e5a-48ea-bbff-49c6ecd5232f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51442025-05-22T21:21:29.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b72e1487-d0bd-46c4-adf2-294234780182 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51452025-05-22T21:21:29.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b72e1487-d0bd-46c4-adf2-294234780182 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51462025-05-22T21:21:29.385ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b72e1487-d0bd-46c4-adf2-294234780182 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51472025-05-22T21:21:30.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb69c9fa-1db1-4fd4-8e5b-d18ac67f9af5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51482025-05-22T21:21:30.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb69c9fa-1db1-4fd4-8e5b-d18ac67f9af5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51492025-05-22T21:21:30.400ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2084 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb69c9fa-1db1-4fd4-8e5b-d18ac67f9af5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51502025-05-22T21:21:31.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01d52b1c-d266-4e2a-a880-13aa717bfeb9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51512025-05-22T21:21:31.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01d52b1c-d266-4e2a-a880-13aa717bfeb9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51522025-05-22T21:21:31.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01d52b1c-d266-4e2a-a880-13aa717bfeb9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51532025-05-22T21:21:32.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbaf3e8c-bb67-4fd4-96e4-054fbcbf36fc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51542025-05-22T21:21:32.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbaf3e8c-bb67-4fd4-96e4-054fbcbf36fc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51552025-05-22T21:21:32.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2086 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbaf3e8c-bb67-4fd4-96e4-054fbcbf36fc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51562025-05-22T21:21:33.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b300ce-7595-44ce-a31b-64cd997b69c2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51572025-05-22T21:21:33.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b300ce-7595-44ce-a31b-64cd997b69c2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51582025-05-22T21:21:33.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1810 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b300ce-7595-44ce-a31b-64cd997b69c2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51592025-05-22T21:21:34.461ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8285cdb6-b9ad-4974-b6f5-bc9bb60c061f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51602025-05-22T21:21:34.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8285cdb6-b9ad-4974-b6f5-bc9bb60c061f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51612025-05-22T21:21:34.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8285cdb6-b9ad-4974-b6f5-bc9bb60c061f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
51622025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
51632025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
51642025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51652025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
51662025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
51672025-05-22T21:21:35.084ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
51682025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51692025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
51702025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
51712025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
51722025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
51732025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51742025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
51752025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
51762025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 5 reason = Timeout
51772025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
51782025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
51792025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
51802025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
51812025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
51822025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
51832025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51842025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
51852025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
51862025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
51872025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51882025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
51892025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51902025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
51912025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51922025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
51932025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51942025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51952025-05-22T21:21:35.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51962025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
51972025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
51982025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
51992025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52002025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52012025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
52022025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
52032025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52042025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
52052025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
52062025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52072025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
52082025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
52092025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52102025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
52112025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
52122025-05-22T21:21:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
52132025-05-22T21:21:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:11:35.085125158 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52142025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52152025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52162025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.71\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
52172025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
52182025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52192025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
52202025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
52212025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
52222025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
52232025-05-22T21:21:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52242025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52252025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52262025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52272025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52282025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52292025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52302025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52312025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
52322025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
52332025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
52342025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52352025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52362025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52372025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
52382025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52392025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
52402025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52412025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52422025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52432025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
52442025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52452025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52462025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52472025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52482025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52492025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52502025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52512025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52522025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52532025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52542025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52552025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52562025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52572025-05-22T21:21:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 229659471 } })
52582025-05-22T21:21:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 229701932 } })
52592025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 5 reason = Timeout
52602025-05-22T21:21:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
52612025-05-22T21:21:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
52622025-05-22T21:21:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
52632025-05-22T21:21:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.416241ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
52642025-05-22T21:21:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
52652025-05-22T21:21:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.415281ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
52662025-05-22T21:21:35.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52672025-05-22T21:21:35.088ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52682025-05-22T21:21:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
52692025-05-22T21:21:35.092ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52702025-05-22T21:21:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52712025-05-22T21:21:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
52722025-05-22T21:21:35.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52732025-05-22T21:21:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.498987ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
52742025-05-22T21:21:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52752025-05-22T21:21:35.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52762025-05-22T21:21:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52772025-05-22T21:21:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.572202ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
52782025-05-22T21:21:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 14.140571ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
52792025-05-22T21:21:35.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52802025-05-22T21:21:35.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52812025-05-22T21:21:35.102ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52822025-05-22T21:21:35.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52832025-05-22T21:21:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52842025-05-22T21:21:35.103ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52852025-05-22T21:21:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52862025-05-22T21:21:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
52872025-05-22T21:21:35.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52882025-05-22T21:21:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52892025-05-22T21:21:35.112ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:11:35.085125158 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
52902025-05-22T21:21:35.112ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 27.514619ms iteration = 5 status = {"expiration":"2025-05-22T21:11:35.085125158Z","pruned":[]}
52912025-05-22T21:21:35.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52922025-05-22T21:21:35.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52932025-05-22T21:21:35.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52942025-05-22T21:21:35.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
52952025-05-22T21:21:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
52962025-05-22T21:21:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
52972025-05-22T21:21:35.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52982025-05-22T21:21:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52992025-05-22T21:21:35.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53002025-05-22T21:21:35.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53012025-05-22T21:21:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53022025-05-22T21:21:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53032025-05-22T21:21:35.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53042025-05-22T21:21:35.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53052025-05-22T21:21:35.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53062025-05-22T21:21:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53072025-05-22T21:21:35.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 267732488 } })
53082025-05-22T21:21:35.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
53092025-05-22T21:21:35.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 268181494 } })
53102025-05-22T21:21:35.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
53112025-05-22T21:21:35.125ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
53122025-05-22T21:21:35.125ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 39.449957ms iteration = 5 status = {"by_rx":{},"error":null}
53132025-05-22T21:21:35.127ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
53142025-05-22T21:21:35.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
53152025-05-22T21:21:35.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53162025-05-22T21:21:35.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53172025-05-22T21:21:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53182025-05-22T21:21:35.132ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53192025-05-22T21:21:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53202025-05-22T21:21:35.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53212025-05-22T21:21:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53222025-05-22T21:21:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53232025-05-22T21:21:35.139ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53242025-05-22T21:21:35.139ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1204, tv_nsec: 283504472 } })
53252025-05-22T21:21:35.139ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
53262025-05-22T21:21:35.140ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53272025-05-22T21:21:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53282025-05-22T21:21:35.142ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53292025-05-22T21:21:35.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53302025-05-22T21:21:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53312025-05-22T21:21:35.144ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 59.468885ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
53322025-05-22T21:21:35.144ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53332025-05-22T21:21:35.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53342025-05-22T21:21:35.145ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 60.991348ms iteration = 5 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
53352025-05-22T21:21:35.147ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53362025-05-22T21:21:35.147ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53372025-05-22T21:21:35.147ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 63.17089ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53382025-05-22T21:21:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
53392025-05-22T21:21:35.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53402025-05-22T21:21:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53412025-05-22T21:21:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53422025-05-22T21:21:35.150ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53432025-05-22T21:21:35.151ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
53442025-05-22T21:21:35.151ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
53452025-05-22T21:21:35.151ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
53462025-05-22T21:21:35.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53472025-05-22T21:21:35.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53482025-05-22T21:21:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53492025-05-22T21:21:35.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53502025-05-22T21:21:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53512025-05-22T21:21:35.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.860409ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
53522025-05-22T21:21:35.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53532025-05-22T21:21:35.159ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53542025-05-22T21:21:35.160ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53552025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53562025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53572025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53582025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53602025-05-22T21:21:35.162ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53612025-05-22T21:21:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53622025-05-22T21:21:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
53632025-05-22T21:21:35.165ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
53642025-05-22T21:21:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
53652025-05-22T21:21:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53662025-05-22T21:21:35.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
53672025-05-22T21:21:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
53682025-05-22T21:21:35.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53692025-05-22T21:21:35.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
53702025-05-22T21:21:35.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53712025-05-22T21:21:35.169ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
53722025-05-22T21:21:35.169ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 84.453966ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
53732025-05-22T21:21:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53742025-05-22T21:21:35.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53752025-05-22T21:21:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53762025-05-22T21:21:35.176ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
53772025-05-22T21:21:35.176ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.238693ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
53782025-05-22T21:21:35.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 91.581953ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53792025-05-22T21:21:35.178ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53802025-05-22T21:21:35.178ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53812025-05-22T21:21:35.178ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53822025-05-22T21:21:35.178ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
53832025-05-22T21:21:35.178ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
53842025-05-22T21:21:35.178ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 94.550917ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
53852025-05-22T21:21:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53862025-05-22T21:21:35.183ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53872025-05-22T21:21:35.183ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
53882025-05-22T21:21:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
53892025-05-22T21:21:35.187ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53902025-05-22T21:21:35.187ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53912025-05-22T21:21:35.187ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53922025-05-22T21:21:35.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53932025-05-22T21:21:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53942025-05-22T21:21:35.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53952025-05-22T21:21:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53962025-05-22T21:21:35.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53972025-05-22T21:21:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53982025-05-22T21:21:35.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53992025-05-22T21:21:35.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54002025-05-22T21:21:35.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54012025-05-22T21:21:35.194ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54022025-05-22T21:21:35.194ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
54032025-05-22T21:21:35.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54042025-05-22T21:21:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54052025-05-22T21:21:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54062025-05-22T21:21:35.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 111.760192ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54072025-05-22T21:21:35.196ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54082025-05-22T21:21:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54092025-05-22T21:21:35.200ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102025-05-22T21:21:35.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112025-05-22T21:21:35.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54122025-05-22T21:21:35.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54132025-05-22T21:21:35.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54142025-05-22T21:21:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
54152025-05-22T21:21:35.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54162025-05-22T21:21:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54172025-05-22T21:21:35.205ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
54182025-05-22T21:21:35.205ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54192025-05-22T21:21:35.205ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
54202025-05-22T21:21:35.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 121.260853ms iteration = 5 status = {"generation":2}
54212025-05-22T21:21:35.206ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 122.268679ms iteration = 9 status = 0
54222025-05-22T21:21:35.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 132.728424ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54232025-05-22T21:21:35.225ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54242025-05-22T21:21:35.225ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54252025-05-22T21:21:35.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54262025-05-22T21:21:35.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54272025-05-22T21:21:35.227ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54282025-05-22T21:21:35.227ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54292025-05-22T21:21:35.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54302025-05-22T21:21:35.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54312025-05-22T21:21:35.230ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54322025-05-22T21:21:35.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.910415ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
54332025-05-22T21:21:35.231ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54342025-05-22T21:21:35.231ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54352025-05-22T21:21:35.231ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 146.730633ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54362025-05-22T21:21:35.236ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54372025-05-22T21:21:35.237ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54382025-05-22T21:21:35.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 153.207779ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54392025-05-22T21:21:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54402025-05-22T21:21:35.240ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54412025-05-22T21:21:35.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54422025-05-22T21:21:35.242ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 157.444132ms iteration = 11 status = {"physical_disks_added":0}
54432025-05-22T21:21:35.256ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
54442025-05-22T21:21:35.256ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54452025-05-22T21:21:35.256ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6522139a-0aed-42ee-9e8e-ee739687e827", "content-length": "26", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
54462025-05-22T21:21:35.256ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54472025-05-22T21:21:35.257ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54482025-05-22T21:21:35.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54492025-05-22T21:21:35.272ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54502025-05-22T21:21:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54512025-05-22T21:21:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54522025-05-22T21:21:35.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54532025-05-22T21:21:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54542025-05-22T21:21:35.276ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
54552025-05-22T21:21:35.276ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54562025-05-22T21:21:35.276ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9ab7a5e-80c1-408b-a789-7e4bf170fdaf", "content-length": "26", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
54572025-05-22T21:21:35.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54582025-05-22T21:21:35.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54592025-05-22T21:21:35.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54602025-05-22T21:21:35.279ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54612025-05-22T21:21:35.286ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
54622025-05-22T21:21:35.286ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54632025-05-22T21:21:35.286ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dea069a-5a55-42bf-b9c1-401329e32bb5", "content-length": "26", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
54642025-05-22T21:21:35.286ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54652025-05-22T21:21:35.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
54662025-05-22T21:21:35.318ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54672025-05-22T21:21:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54682025-05-22T21:21:35.348ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
54692025-05-22T21:21:35.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "ce01ac43-dccb-4178-ba1b-6f69ea985369", "date": "Thu, 22 May 2025 21:21:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54702025-05-22T21:21:35.348ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54712025-05-22T21:21:35.350ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "353bbe82-4261-4d38-910c-4ec787ae00be", "date": "Thu, 22 May 2025 21:21:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54722025-05-22T21:21:35.350ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54732025-05-22T21:21:35.352ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
54742025-05-22T21:21:35.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 267.611782ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
54752025-05-22T21:21:35.370ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
54762025-05-22T21:21:35.370ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 285.928635ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
54772025-05-22T21:21:35.429ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54782025-05-22T21:21:35.430ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54792025-05-22T21:21:35.430ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e81cd9b6-7ed5-4db2-9c6b-4249defbab18", "content-length": "372", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
54802025-05-22T21:21:35.430ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54812025-05-22T21:21:35.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54822025-05-22T21:21:35.432ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54832025-05-22T21:21:35.433ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
54842025-05-22T21:21:35.433ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
54852025-05-22T21:21:35.433ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
54862025-05-22T21:21:35.433ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 348.488775ms iteration = 5 status = {"generation":1}
54872025-05-22T21:21:35.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54882025-05-22T21:21:35.435ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54892025-05-22T21:21:35.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54902025-05-22T21:21:35.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54912025-05-22T21:21:35.436ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54922025-05-22T21:21:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54932025-05-22T21:21:35.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54942025-05-22T21:21:35.437ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54952025-05-22T21:21:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54962025-05-22T21:21:35.442ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 357.572721ms iteration = 9 status = null
54972025-05-22T21:21:35.443ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54982025-05-22T21:21:35.445ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54992025-05-22T21:21:35.445ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55002025-05-22T21:21:35.445ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55012025-05-22T21:21:35.469ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55022025-05-22T21:21:35.477ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59aeb2c0-a1d3-4903-811f-905461da72b5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55032025-05-22T21:21:35.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59aeb2c0-a1d3-4903-811f-905461da72b5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55042025-05-22T21:21:35.479ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2210 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59aeb2c0-a1d3-4903-811f-905461da72b5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55052025-05-22T21:21:35.485ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
55062025-05-22T21:21:35.486ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 400.831604ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
55072025-05-22T21:21:35.509ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55082025-05-22T21:21:35.509ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55092025-05-22T21:21:35.509ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "53f8bc06-f535-4f03-8e35-c7a6614006c3", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
55102025-05-22T21:21:35.509ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55112025-05-22T21:21:35.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55122025-05-22T21:21:35.578ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 492.807163ms iteration = 9 status = {}
55132025-05-22T21:21:35.591ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55142025-05-22T21:21:35.595ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55152025-05-22T21:21:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55162025-05-22T21:21:35.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55172025-05-22T21:21:35.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55182025-05-22T21:21:35.623ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
55192025-05-22T21:21:35.623ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55202025-05-22T21:21:35.624ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
55212025-05-22T21:21:35.625ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "eae3687e-951d-4bf9-90fe-9fa3ee387b50", "date": "Thu, 22 May 2025 21:21:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55222025-05-22T21:21:35.625ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55232025-05-22T21:21:35.626ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6dc5911f-1fad-4093-89ba-3eecb3c3410b", "date": "Thu, 22 May 2025 21:21:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55242025-05-22T21:21:35.626ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55252025-05-22T21:21:35.628ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "d0d76537-c264-42b7-b6bb-b1b7f2375e95", "date": "Thu, 22 May 2025 21:21:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55262025-05-22T21:21:35.628ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55272025-05-22T21:21:35.630ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
55282025-05-22T21:21:35.630ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 546.259769ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55292025-05-22T21:21:35.640ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55302025-05-22T21:21:35.641ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55312025-05-22T21:21:35.642ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
55322025-05-22T21:21:35.642ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55332025-05-22T21:21:35.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55342025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55352025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
55362025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55372025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55382025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55392025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55402025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55412025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55422025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55432025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55442025-05-22T21:21:35.655ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
55452025-05-22T21:21:35.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55462025-05-22T21:21:35.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55472025-05-22T21:21:35.658ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
55482025-05-22T21:21:35.658ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55492025-05-22T21:21:35.702ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2b1e8bdb-9955-4ebf-8789-d2dea49db933", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
55502025-05-22T21:21:35.703ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 618.24079ms iteration = 9 status = {}
55512025-05-22T21:21:35.703ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f75f55-28c3-4268-ae7c-41aed9c5fb95", "content-length": "691", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
55522025-05-22T21:21:35.703ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
55532025-05-22T21:21:35.703ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
55542025-05-22T21:21:35.703ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
55552025-05-22T21:21:35.704ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 619.61186ms iteration = 9 status = {}
55562025-05-22T21:21:35.805ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "010bc3bb-60c9-46b7-b9f3-8fb9a7637e57", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
55572025-05-22T21:21:35.805ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
55582025-05-22T21:21:35.805ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55592025-05-22T21:21:35.805ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e2e63d-0243-4f4d-9e32-2e18f204c816", "content-length": "682", "date": "Thu, 22 May 2025 21:21:35 GMT"} })
55602025-05-22T21:21:35.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55612025-05-22T21:21:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55622025-05-22T21:21:35.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55632025-05-22T21:21:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55642025-05-22T21:21:35.813ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55652025-05-22T21:21:35.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55662025-05-22T21:21:35.815ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55672025-05-22T21:21:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55682025-05-22T21:21:35.822ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 737.555915ms iteration = 9 status = {}
55692025-05-22T21:21:36.495ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 85ef1971-bef5-49c0-ab10-3774f041b3c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55702025-05-22T21:21:36.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 85ef1971-bef5-49c0-ab10-3774f041b3c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55712025-05-22T21:21:36.497ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 85ef1971-bef5-49c0-ab10-3774f041b3c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55722025-05-22T21:21:37.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = de0630cc-85ae-43ca-b0f0-6aa751be6666 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55732025-05-22T21:21:37.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = de0630cc-85ae-43ca-b0f0-6aa751be6666 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55742025-05-22T21:21:37.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = de0630cc-85ae-43ca-b0f0-6aa751be6666 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55752025-05-22T21:21:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 530 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = cefd8ff1-3f55-4718-83d4-9aa0ec6afd8a response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
55762025-05-22T21:21:38.527ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06fd7aec-b838-4d77-8f41-2f4b78e63416 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55772025-05-22T21:21:38.527ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06fd7aec-b838-4d77-8f41-2f4b78e63416 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55782025-05-22T21:21:38.529ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2467 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06fd7aec-b838-4d77-8f41-2f4b78e63416 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55792025-05-22T21:21:39.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e671740c-7735-4c6a-898e-0e8c9b89c001 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55802025-05-22T21:21:39.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e671740c-7735-4c6a-898e-0e8c9b89c001 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55812025-05-22T21:21:39.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e671740c-7735-4c6a-898e-0e8c9b89c001 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55822025-05-22T21:21:40.559ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e79cc40-3125-4564-b55b-96b6490891c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55832025-05-22T21:21:40.559ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e79cc40-3125-4564-b55b-96b6490891c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55842025-05-22T21:21:40.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e79cc40-3125-4564-b55b-96b6490891c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55852025-05-22T21:21:41.575ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8adc23f-16e1-4b9b-86f1-0193b6823485 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55862025-05-22T21:21:41.576ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8adc23f-16e1-4b9b-86f1-0193b6823485 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55872025-05-22T21:21:41.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1870 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f8adc23f-16e1-4b9b-86f1-0193b6823485 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55882025-05-22T21:21:42.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3003a36f-51d6-4e5a-afa0-51d85188329a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55892025-05-22T21:21:42.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3003a36f-51d6-4e5a-afa0-51d85188329a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55902025-05-22T21:21:42.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3003a36f-51d6-4e5a-afa0-51d85188329a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55912025-05-22T21:21:43.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9363154-152b-437e-8923-5d474b3fb5dc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55922025-05-22T21:21:43.606ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9363154-152b-437e-8923-5d474b3fb5dc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55932025-05-22T21:21:43.608ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9363154-152b-437e-8923-5d474b3fb5dc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55942025-05-22T21:21:44.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 82265721-c61c-4647-a7b4-a5133ee119c1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55952025-05-22T21:21:44.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 82265721-c61c-4647-a7b4-a5133ee119c1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55962025-05-22T21:21:44.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 82265721-c61c-4647-a7b4-a5133ee119c1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
55972025-05-22T21:21:45.083ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
55982025-05-22T21:21:45.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55992025-05-22T21:21:45.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
56002025-05-22T21:21:45.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56012025-05-22T21:21:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56022025-05-22T21:21:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56032025-05-22T21:21:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56042025-05-22T21:21:45.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56052025-05-22T21:21:45.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56062025-05-22T21:21:45.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56072025-05-22T21:21:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56082025-05-22T21:21:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56092025-05-22T21:21:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56102025-05-22T21:21:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
56112025-05-22T21:21:45.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56122025-05-22T21:21:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56132025-05-22T21:21:45.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
56142025-05-22T21:21:45.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.496055ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
56152025-05-22T21:21:45.115ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56162025-05-22T21:21:45.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56172025-05-22T21:21:45.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.804455ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56182025-05-22T21:21:45.637ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4961f0af-c942-4c42-8317-566517258657 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56192025-05-22T21:21:45.637ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4961f0af-c942-4c42-8317-566517258657 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56202025-05-22T21:21:45.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2132 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4961f0af-c942-4c42-8317-566517258657 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56212025-05-22T21:21:46.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 163fa471-26b6-4dcd-bdaf-839411ef68e3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56222025-05-22T21:21:46.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 163fa471-26b6-4dcd-bdaf-839411ef68e3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56232025-05-22T21:21:46.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1379 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 163fa471-26b6-4dcd-bdaf-839411ef68e3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56242025-05-22T21:21:47.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3446c22-444a-4d4c-bbb3-2e615c9eeb37 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56252025-05-22T21:21:47.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3446c22-444a-4d4c-bbb3-2e615c9eeb37 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56262025-05-22T21:21:47.668ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3446c22-444a-4d4c-bbb3-2e615c9eeb37 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56272025-05-22T21:21:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 622 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = a8b55586-35ce-4316-9337-5bbbdf99c962 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
56282025-05-22T21:21:48.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc2de210-aff3-4c0d-97bb-65a961135964 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56292025-05-22T21:21:48.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc2de210-aff3-4c0d-97bb-65a961135964 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56302025-05-22T21:21:48.684ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc2de210-aff3-4c0d-97bb-65a961135964 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56312025-05-22T21:21:49.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77604cad-d437-4b3e-9fdb-40e7902efd60 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56322025-05-22T21:21:49.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77604cad-d437-4b3e-9fdb-40e7902efd60 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56332025-05-22T21:21:49.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 77604cad-d437-4b3e-9fdb-40e7902efd60 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56342025-05-22T21:21:50.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a6050bd-0e80-4e70-9e82-190f93f6c201 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56352025-05-22T21:21:50.713ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a6050bd-0e80-4e70-9e82-190f93f6c201 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56362025-05-22T21:21:50.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2393 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a6050bd-0e80-4e70-9e82-190f93f6c201 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56372025-05-22T21:21:51.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01142bde-914f-4877-bd9c-7633a0d3b11c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56382025-05-22T21:21:51.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01142bde-914f-4877-bd9c-7633a0d3b11c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56392025-05-22T21:21:51.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 01142bde-914f-4877-bd9c-7633a0d3b11c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56402025-05-22T21:21:52.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b2e2a766-28af-476c-a72f-d1c4815f17bd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56412025-05-22T21:21:52.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b2e2a766-28af-476c-a72f-d1c4815f17bd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56422025-05-22T21:21:52.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2149 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b2e2a766-28af-476c-a72f-d1c4815f17bd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56432025-05-22T21:21:53.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8822a9-a6e8-4943-8b67-02ebdf218626 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56442025-05-22T21:21:53.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8822a9-a6e8-4943-8b67-02ebdf218626 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56452025-05-22T21:21:53.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8822a9-a6e8-4943-8b67-02ebdf218626 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56462025-05-22T21:21:54.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = af590a7b-b523-4fb5-a541-f673e91f37f4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56472025-05-22T21:21:54.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = af590a7b-b523-4fb5-a541-f673e91f37f4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56482025-05-22T21:21:54.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2795 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = af590a7b-b523-4fb5-a541-f673e91f37f4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56492025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
56502025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
56512025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56522025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56532025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56542025-05-22T21:21:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56552025-05-22T21:21:55.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56562025-05-22T21:21:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56572025-05-22T21:21:55.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.357545ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56582025-05-22T21:21:55.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56592025-05-22T21:21:55.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56602025-05-22T21:21:55.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56612025-05-22T21:21:55.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56622025-05-22T21:21:55.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56632025-05-22T21:21:55.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56642025-05-22T21:21:55.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56652025-05-22T21:21:55.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
56662025-05-22T21:21:55.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56672025-05-22T21:21:55.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56682025-05-22T21:21:55.140ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
56692025-05-22T21:21:55.140ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 55.943752ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
56702025-05-22T21:21:55.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = da802e26-a5a8-4708-aab4-42300e5fe068 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56712025-05-22T21:21:55.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = da802e26-a5a8-4708-aab4-42300e5fe068 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56722025-05-22T21:21:55.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = da802e26-a5a8-4708-aab4-42300e5fe068 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56732025-05-22T21:21:56.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b849b69c-c30e-41ba-8e30-e371ec48b193 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56742025-05-22T21:21:56.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b849b69c-c30e-41ba-8e30-e371ec48b193 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56752025-05-22T21:21:56.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b849b69c-c30e-41ba-8e30-e371ec48b193 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56762025-05-22T21:21:57.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eb6a2d1d-2fcc-47c3-9a24-20351b2c231b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56772025-05-22T21:21:57.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eb6a2d1d-2fcc-47c3-9a24-20351b2c231b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56782025-05-22T21:21:57.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eb6a2d1d-2fcc-47c3-9a24-20351b2c231b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56792025-05-22T21:21:58.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 453 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 6b9ac78f-5ac8-41e0-a4d7-770a4247ccd0 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
56802025-05-22T21:21:58.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21086e29-852b-481f-afb6-286a4bf868d4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56812025-05-22T21:21:58.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21086e29-852b-481f-afb6-286a4bf868d4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56822025-05-22T21:21:58.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21086e29-852b-481f-afb6-286a4bf868d4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56832025-05-22T21:21:59.854ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ff31212-c9b2-41b4-8f45-204d698b200a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56842025-05-22T21:21:59.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ff31212-c9b2-41b4-8f45-204d698b200a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56852025-05-22T21:21:59.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8ff31212-c9b2-41b4-8f45-204d698b200a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56862025-05-22T21:22:00.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f21fd189-7abb-4332-a8cc-49adb6b751d5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56872025-05-22T21:22:00.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f21fd189-7abb-4332-a8cc-49adb6b751d5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56882025-05-22T21:22:00.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f21fd189-7abb-4332-a8cc-49adb6b751d5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56892025-05-22T21:22:01.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1372979e-fe3a-4893-87a9-46b4a816978f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56902025-05-22T21:22:01.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1372979e-fe3a-4893-87a9-46b4a816978f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56912025-05-22T21:22:01.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2582 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1372979e-fe3a-4893-87a9-46b4a816978f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56922025-05-22T21:22:02.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83ae6c23-017e-4b69-b745-ed31d40338ed roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56932025-05-22T21:22:02.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83ae6c23-017e-4b69-b745-ed31d40338ed resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56942025-05-22T21:22:02.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83ae6c23-017e-4b69-b745-ed31d40338ed response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56952025-05-22T21:22:03.918ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a99d182e-a937-48f3-bb6f-24003d26d086 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56962025-05-22T21:22:03.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a99d182e-a937-48f3-bb6f-24003d26d086 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56972025-05-22T21:22:03.920ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2314 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a99d182e-a937-48f3-bb6f-24003d26d086 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56982025-05-22T21:22:04.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fc63ced-0bca-449f-9470-09525f699d8c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
56992025-05-22T21:22:04.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fc63ced-0bca-449f-9470-09525f699d8c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
57002025-05-22T21:22:04.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2826 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fc63ced-0bca-449f-9470-09525f699d8c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
57012025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
57022025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
57032025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57042025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57052025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
57062025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
57072025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57082025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57092025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
57102025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57112025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
57122025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57132025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57142025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
57152025-05-22T21:22:05.083ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57162025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
57172025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
57182025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57192025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57202025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57212025-05-22T21:22:05.083ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
57222025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
57232025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57242025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57252025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
57262025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57272025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
57282025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57292025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
57302025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57312025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
57322025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57332025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
57342025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57352025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
57362025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57372025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
57382025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
57392025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
57402025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57412025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57422025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57432025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57442025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57452025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57462025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
57472025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57482025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57492025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57502025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
57512025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57522025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57532025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57542025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57552025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57562025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57572025-05-22T21:22:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
57582025-05-22T21:22:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57592025-05-22T21:22:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57602025-05-22T21:22:05.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57612025-05-22T21:22:05.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57622025-05-22T21:22:05.091ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 235134441 } })
57632025-05-22T21:22:05.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.161657ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
57642025-05-22T21:22:05.091ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
57652025-05-22T21:22:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57662025-05-22T21:22:05.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57672025-05-22T21:22:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57682025-05-22T21:22:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57692025-05-22T21:22:05.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57702025-05-22T21:22:05.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57712025-05-22T21:22:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57722025-05-22T21:22:05.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57732025-05-22T21:22:05.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57742025-05-22T21:22:05.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57752025-05-22T21:22:05.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 240808066 } })
57762025-05-22T21:22:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57772025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57782025-05-22T21:22:05.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
57792025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57802025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57812025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57822025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57832025-05-22T21:22:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57842025-05-22T21:22:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57852025-05-22T21:22:05.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57862025-05-22T21:22:05.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57872025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
57882025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
57892025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
57902025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57912025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57922025-05-22T21:22:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57932025-05-22T21:22:05.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57942025-05-22T21:22:05.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57952025-05-22T21:22:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57962025-05-22T21:22:05.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1234, tv_nsec: 253177640 } })
57972025-05-22T21:22:05.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
57982025-05-22T21:22:05.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57992025-05-22T21:22:05.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58002025-05-22T21:22:05.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58012025-05-22T21:22:05.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58022025-05-22T21:22:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58032025-05-22T21:22:05.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58042025-05-22T21:22:05.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.532231ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
58052025-05-22T21:22:05.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58062025-05-22T21:22:05.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58072025-05-22T21:22:05.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58082025-05-22T21:22:05.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58092025-05-22T21:22:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58102025-05-22T21:22:05.149ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58112025-05-22T21:22:05.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58122025-05-22T21:22:05.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.45242ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
58132025-05-22T21:22:05.151ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58142025-05-22T21:22:05.151ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58152025-05-22T21:22:05.151ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58162025-05-22T21:22:05.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58172025-05-22T21:22:05.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58182025-05-22T21:22:05.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58192025-05-22T21:22:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58202025-05-22T21:22:05.153ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
58212025-05-22T21:22:05.153ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.579896ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
58222025-05-22T21:22:05.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.552925ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58232025-05-22T21:22:05.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58242025-05-22T21:22:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58252025-05-22T21:22:05.154ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 70.491279ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
58262025-05-22T21:22:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
58272025-05-22T21:22:05.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58282025-05-22T21:22:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58292025-05-22T21:22:05.158ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58302025-05-22T21:22:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58312025-05-22T21:22:05.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58322025-05-22T21:22:05.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58332025-05-22T21:22:05.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.641825ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58342025-05-22T21:22:05.165ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
58352025-05-22T21:22:05.165ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 82.112812ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
58362025-05-22T21:22:05.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58372025-05-22T21:22:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58382025-05-22T21:22:05.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58392025-05-22T21:22:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58402025-05-22T21:22:05.180ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 96.974084ms iteration = 12 status = {"physical_disks_added":0}
58412025-05-22T21:22:05.182ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
58422025-05-22T21:22:05.182ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58432025-05-22T21:22:05.183ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "38fadb15-9b69-470f-949d-11bba21c0ed2", "content-length": "26", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58442025-05-22T21:22:05.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58452025-05-22T21:22:05.184ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58462025-05-22T21:22:05.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 109.666942ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
58472025-05-22T21:22:05.193ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58482025-05-22T21:22:05.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
58492025-05-22T21:22:05.193ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58502025-05-22T21:22:05.194ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68e13447-b71d-4df7-8abe-449e7139db37", "content-length": "26", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58512025-05-22T21:22:05.194ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58522025-05-22T21:22:05.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
58532025-05-22T21:22:05.195ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
58542025-05-22T21:22:05.195ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
58552025-05-22T21:22:05.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
58562025-05-22T21:22:05.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.479333ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
58572025-05-22T21:22:05.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582025-05-22T21:22:05.204ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58592025-05-22T21:22:05.204ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
58602025-05-22T21:22:05.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58612025-05-22T21:22:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58622025-05-22T21:22:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
58632025-05-22T21:22:05.205ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58642025-05-22T21:22:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58652025-05-22T21:22:05.207ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.614069ms iteration = 10 status = 0
58662025-05-22T21:22:05.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
58672025-05-22T21:22:05.210ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
58682025-05-22T21:22:05.210ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "46269a66-20b9-4d89-8ec9-03015223d90a", "content-length": "26", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58692025-05-22T21:22:05.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
58702025-05-22T21:22:05.213ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
58712025-05-22T21:22:05.235ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
58722025-05-22T21:22:05.235ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 151.461104ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
58732025-05-22T21:22:05.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58742025-05-22T21:22:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58752025-05-22T21:22:05.263ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58762025-05-22T21:22:05.263ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
58772025-05-22T21:22:05.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 179.363568ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
58782025-05-22T21:22:05.300ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 217.09701ms iteration = 10 status = {}
58792025-05-22T21:22:05.306ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
58802025-05-22T21:22:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
58812025-05-22T21:22:05.309ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
58822025-05-22T21:22:05.309ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58832025-05-22T21:22:05.309ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b14a7b1-02c8-48c5-8fb9-4b5f475bcd4d", "content-length": "372", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58842025-05-22T21:22:05.309ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58852025-05-22T21:22:05.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58862025-05-22T21:22:05.311ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 227.88335ms iteration = 10 status = null
58872025-05-22T21:22:05.358ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
58882025-05-22T21:22:05.358ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
58892025-05-22T21:22:05.358ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e653600f-fa85-49f1-a69a-6367866dc7e4", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58902025-05-22T21:22:05.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58912025-05-22T21:22:05.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58922025-05-22T21:22:05.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58932025-05-22T21:22:05.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58942025-05-22T21:22:05.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58952025-05-22T21:22:05.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58962025-05-22T21:22:05.366ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58972025-05-22T21:22:05.366ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58982025-05-22T21:22:05.366ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3768b63b-fa89-4c86-943b-445c6a407690", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
58992025-05-22T21:22:05.368ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 284.27473ms iteration = 10 status = {}
59002025-05-22T21:22:05.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59012025-05-22T21:22:05.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59022025-05-22T21:22:05.372ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
59032025-05-22T21:22:05.372ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59042025-05-22T21:22:05.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59052025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
59062025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
59072025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
59082025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
59092025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59102025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59112025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59122025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59132025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
59142025-05-22T21:22:05.388ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
59152025-05-22T21:22:05.389ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
59162025-05-22T21:22:05.389ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59172025-05-22T21:22:05.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59182025-05-22T21:22:05.391ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
59192025-05-22T21:22:05.391ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
59202025-05-22T21:22:05.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59212025-05-22T21:22:05.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59222025-05-22T21:22:05.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59232025-05-22T21:22:05.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59242025-05-22T21:22:05.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59252025-05-22T21:22:05.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59262025-05-22T21:22:05.481ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59272025-05-22T21:22:05.483ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59282025-05-22T21:22:05.483ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59292025-05-22T21:22:05.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59302025-05-22T21:22:05.497ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "073f45d9-1428-4f9e-8504-b5447353aef4", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
59312025-05-22T21:22:05.498ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
59322025-05-22T21:22:05.498ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
59332025-05-22T21:22:05.498ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ecc3d28-b1e3-43f2-86a3-54555a9951d3", "content-length": "682", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
59342025-05-22T21:22:05.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59352025-05-22T21:22:05.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59362025-05-22T21:22:05.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59372025-05-22T21:22:05.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59382025-05-22T21:22:05.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59392025-05-22T21:22:05.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59402025-05-22T21:22:05.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59412025-05-22T21:22:05.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59422025-05-22T21:22:05.514ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.598237ms iteration = 10 status = {}
59432025-05-22T21:22:05.595ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
59442025-05-22T21:22:05.596ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ee3e637-5c51-4338-940e-529f54d9f870", "content-length": "691", "date": "Thu, 22 May 2025 21:22:05 GMT"} })
59452025-05-22T21:22:05.596ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
59462025-05-22T21:22:05.596ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
59472025-05-22T21:22:05.596ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
59482025-05-22T21:22:05.598ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 514.724659ms iteration = 10 status = {}
59492025-05-22T21:22:05.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a6df617-477e-4d51-aa9f-7edeaa60a39d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59502025-05-22T21:22:05.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a6df617-477e-4d51-aa9f-7edeaa60a39d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59512025-05-22T21:22:05.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a6df617-477e-4d51-aa9f-7edeaa60a39d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59522025-05-22T21:22:06.985ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 502cbb10-baba-43e9-8240-faa0fbb0ab35 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59532025-05-22T21:22:06.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 502cbb10-baba-43e9-8240-faa0fbb0ab35 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59542025-05-22T21:22:06.987ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2427 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 502cbb10-baba-43e9-8240-faa0fbb0ab35 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59552025-05-22T21:22:08.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e50d4ff8-1e6e-49a6-a36d-ea2287258180 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59562025-05-22T21:22:08.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e50d4ff8-1e6e-49a6-a36d-ea2287258180 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59572025-05-22T21:22:08.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2778 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e50d4ff8-1e6e-49a6-a36d-ea2287258180 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59582025-05-22T21:22:08.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 466 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = b12f856d-bd28-401d-b684-dae50ba79dca response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
59592025-05-22T21:22:09.017ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4c9ce06-b600-411a-aba1-e596f78b2270 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59602025-05-22T21:22:09.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4c9ce06-b600-411a-aba1-e596f78b2270 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59612025-05-22T21:22:09.020ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d4c9ce06-b600-411a-aba1-e596f78b2270 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59622025-05-22T21:22:10.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1904fc4e-2e73-43b1-942a-9c616ff1977c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59632025-05-22T21:22:10.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1904fc4e-2e73-43b1-942a-9c616ff1977c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59642025-05-22T21:22:10.036ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1904fc4e-2e73-43b1-942a-9c616ff1977c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59652025-05-22T21:22:11.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59757070-e016-451b-a95a-7910ce6cc570 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59662025-05-22T21:22:11.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59757070-e016-451b-a95a-7910ce6cc570 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59672025-05-22T21:22:11.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 59757070-e016-451b-a95a-7910ce6cc570 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59682025-05-22T21:22:12.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faf078ce-970c-4a28-8e45-cdcf6e965708 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59692025-05-22T21:22:12.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faf078ce-970c-4a28-8e45-cdcf6e965708 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59702025-05-22T21:22:12.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = faf078ce-970c-4a28-8e45-cdcf6e965708 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59712025-05-22T21:22:13.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05dea878-976c-414f-b51f-793965f2dc1f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59722025-05-22T21:22:13.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05dea878-976c-414f-b51f-793965f2dc1f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59732025-05-22T21:22:13.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2205 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05dea878-976c-414f-b51f-793965f2dc1f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59742025-05-22T21:22:14.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6774cb62-8eb4-4a2f-8bfd-14ac265820b5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59752025-05-22T21:22:14.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6774cb62-8eb4-4a2f-8bfd-14ac265820b5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59762025-05-22T21:22:14.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6774cb62-8eb4-4a2f-8bfd-14ac265820b5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59772025-05-22T21:22:15.083ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
59782025-05-22T21:22:15.083ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
59792025-05-22T21:22:15.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59802025-05-22T21:22:15.083ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59812025-05-22T21:22:15.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59822025-05-22T21:22:15.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59832025-05-22T21:22:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59842025-05-22T21:22:15.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59852025-05-22T21:22:15.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59862025-05-22T21:22:15.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59872025-05-22T21:22:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59882025-05-22T21:22:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59892025-05-22T21:22:15.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9575701e-79c6-4366-ad65-f54b0a252655 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59902025-05-22T21:22:15.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9575701e-79c6-4366-ad65-f54b0a252655 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59912025-05-22T21:22:15.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2458 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9575701e-79c6-4366-ad65-f54b0a252655 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
59922025-05-22T21:22:15.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59932025-05-22T21:22:15.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59942025-05-22T21:22:15.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59952025-05-22T21:22:15.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
59962025-05-22T21:22:15.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59972025-05-22T21:22:15.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59982025-05-22T21:22:15.142ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
59992025-05-22T21:22:15.142ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.207117ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
60002025-05-22T21:22:15.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.839774ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60012025-05-22T21:22:16.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7037b09f-03fd-4515-bcab-d87e043e6869 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60022025-05-22T21:22:16.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7037b09f-03fd-4515-bcab-d87e043e6869 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60032025-05-22T21:22:16.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7037b09f-03fd-4515-bcab-d87e043e6869 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60042025-05-22T21:22:17.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4dc057a-42b5-4601-a573-6bfc4a001baa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60052025-05-22T21:22:17.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4dc057a-42b5-4601-a573-6bfc4a001baa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60062025-05-22T21:22:17.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4dc057a-42b5-4601-a573-6bfc4a001baa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60072025-05-22T21:22:18.158ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 492 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = d6f39029-77cf-4f2b-9441-a5dff2b0e868 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
60082025-05-22T21:22:18.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3cf97f44-5ad0-4c6f-90a4-ec245f49d2b1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60092025-05-22T21:22:18.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3cf97f44-5ad0-4c6f-90a4-ec245f49d2b1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60102025-05-22T21:22:18.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3cf97f44-5ad0-4c6f-90a4-ec245f49d2b1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60112025-05-22T21:22:19.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 44e4194a-ae81-4bf7-af6a-26de928bd27f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60122025-05-22T21:22:19.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 44e4194a-ae81-4bf7-af6a-26de928bd27f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60132025-05-22T21:22:19.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 44e4194a-ae81-4bf7-af6a-26de928bd27f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60142025-05-22T21:22:20.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5740b878-39e8-4178-9c6f-d92a209168ed roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60152025-05-22T21:22:20.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5740b878-39e8-4178-9c6f-d92a209168ed resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60162025-05-22T21:22:20.198ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5740b878-39e8-4178-9c6f-d92a209168ed response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60172025-05-22T21:22:21.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 70e99c8c-cb11-464d-9ab4-7db29fcbf191 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60182025-05-22T21:22:21.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 70e99c8c-cb11-464d-9ab4-7db29fcbf191 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60192025-05-22T21:22:21.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2329 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 70e99c8c-cb11-464d-9ab4-7db29fcbf191 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60202025-05-22T21:22:22.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f0bc7afb-8d21-4df4-a16b-8cec639e7c5b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60212025-05-22T21:22:22.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f0bc7afb-8d21-4df4-a16b-8cec639e7c5b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60222025-05-22T21:22:22.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2702 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f0bc7afb-8d21-4df4-a16b-8cec639e7c5b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60232025-05-22T21:22:23.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df99477a-7c02-4c44-b08d-205b957e3a26 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60242025-05-22T21:22:23.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df99477a-7c02-4c44-b08d-205b957e3a26 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60252025-05-22T21:22:23.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df99477a-7c02-4c44-b08d-205b957e3a26 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60262025-05-22T21:22:24.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25c1863b-97ac-49b6-a25d-89ad83f7ace0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60272025-05-22T21:22:24.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25c1863b-97ac-49b6-a25d-89ad83f7ace0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60282025-05-22T21:22:24.261ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2264 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 25c1863b-97ac-49b6-a25d-89ad83f7ace0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60292025-05-22T21:22:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
60302025-05-22T21:22:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60312025-05-22T21:22:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
60322025-05-22T21:22:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60332025-05-22T21:22:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60342025-05-22T21:22:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60352025-05-22T21:22:25.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60362025-05-22T21:22:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60372025-05-22T21:22:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60382025-05-22T21:22:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60392025-05-22T21:22:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60402025-05-22T21:22:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60412025-05-22T21:22:25.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60422025-05-22T21:22:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
60432025-05-22T21:22:25.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60442025-05-22T21:22:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60452025-05-22T21:22:25.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
60462025-05-22T21:22:25.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.232571ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
60472025-05-22T21:22:25.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60482025-05-22T21:22:25.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60492025-05-22T21:22:25.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.009361ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
60502025-05-22T21:22:25.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db304cf4-17fe-49c3-b405-84de988b4347 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60512025-05-22T21:22:25.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db304cf4-17fe-49c3-b405-84de988b4347 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60522025-05-22T21:22:25.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = db304cf4-17fe-49c3-b405-84de988b4347 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60532025-05-22T21:22:26.289ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c89a3680-1beb-4154-b939-9fc142d5f367 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60542025-05-22T21:22:26.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c89a3680-1beb-4154-b939-9fc142d5f367 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60552025-05-22T21:22:26.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1933 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c89a3680-1beb-4154-b939-9fc142d5f367 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60562025-05-22T21:22:27.304ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5aa4e342-1c82-4dc1-907e-33fdb704213d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60572025-05-22T21:22:27.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5aa4e342-1c82-4dc1-907e-33fdb704213d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60582025-05-22T21:22:27.306ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5aa4e342-1c82-4dc1-907e-33fdb704213d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60592025-05-22T21:22:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 505 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = a25d8b62-265d-4063-9632-77aa22f145bc response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
60602025-05-22T21:22:28.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 818bccc0-a33f-45dd-967c-286a6384d92b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60612025-05-22T21:22:28.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 818bccc0-a33f-45dd-967c-286a6384d92b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60622025-05-22T21:22:28.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 818bccc0-a33f-45dd-967c-286a6384d92b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60632025-05-22T21:22:29.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdebbc09-9600-4e55-83d4-60d5970c010f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60642025-05-22T21:22:29.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdebbc09-9600-4e55-83d4-60d5970c010f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60652025-05-22T21:22:29.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdebbc09-9600-4e55-83d4-60d5970c010f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60662025-05-22T21:22:30.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 367d042c-aa46-4806-b51c-93ac457334ca roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60672025-05-22T21:22:30.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 367d042c-aa46-4806-b51c-93ac457334ca resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60682025-05-22T21:22:30.354ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 367d042c-aa46-4806-b51c-93ac457334ca response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60692025-05-22T21:22:31.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3da7f4f7-8065-47c9-9090-e0d2ac6439f5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60702025-05-22T21:22:31.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3da7f4f7-8065-47c9-9090-e0d2ac6439f5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60712025-05-22T21:22:31.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3da7f4f7-8065-47c9-9090-e0d2ac6439f5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60722025-05-22T21:22:32.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3c14f2f-e2df-4db4-b3fd-aee88b94e9f5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60732025-05-22T21:22:32.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3c14f2f-e2df-4db4-b3fd-aee88b94e9f5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60742025-05-22T21:22:32.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2162 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3c14f2f-e2df-4db4-b3fd-aee88b94e9f5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60752025-05-22T21:22:33.152ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:46625
60762025-05-22T21:22:33.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 3b348533-79ad-44f2-bd36-4002fabcdd8b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
60772025-05-22T21:22:33.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 3b348533-79ad-44f2-bd36-4002fabcdd8b resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
60782025-05-22T21:22:33.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3642 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 3b348533-79ad-44f2-bd36-4002fabcdd8b response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
60792025-05-22T21:22:33.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 8a5e7af4-7fb1-4089-ad28-32d70fca4491 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
60802025-05-22T21:22:33.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 8a5e7af4-7fb1-4089-ad28-32d70fca4491 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
60812025-05-22T21:22:33.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2513 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 8a5e7af4-7fb1-4089-ad28-32d70fca4491 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
60822025-05-22T21:22:33.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cc946f65-2def-4ca4-887b-40ae9c74f5f9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60832025-05-22T21:22:33.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cc946f65-2def-4ca4-887b-40ae9c74f5f9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60842025-05-22T21:22:33.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cc946f65-2def-4ca4-887b-40ae9c74f5f9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60852025-05-22T21:22:34.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e44a122d-58fe-4025-8e36-18962c309b08 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60862025-05-22T21:22:34.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e44a122d-58fe-4025-8e36-18962c309b08 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60872025-05-22T21:22:34.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2937 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e44a122d-58fe-4025-8e36-18962c309b08 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
60882025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
60892025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
60902025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
60912025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 6 reason = Timeout
60922025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
60932025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
60942025-05-22T21:22:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
60952025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
60962025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.78\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
60972025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
60982025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60992025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
61002025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61012025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
61022025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
61032025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
61042025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
61052025-05-22T21:22:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:12:35.085193983 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
61062025-05-22T21:22:35.085ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
61072025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
61082025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61092025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
61102025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
61112025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
61122025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61132025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61142025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
61152025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61162025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
61172025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
61182025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61192025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
61202025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
61212025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61222025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
61232025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61242025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
61252025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61262025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
61272025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61282025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
61292025-05-22T21:22:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
61302025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61312025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61322025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
61332025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61342025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
61352025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61362025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
61372025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61382025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
61392025-05-22T21:22:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
61402025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
61412025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61422025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61432025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
61442025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
61452025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
61462025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
61472025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61482025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
61492025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
61502025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
61512025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
61522025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61532025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
61542025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61552025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
61562025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
61572025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
61582025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
61592025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
61602025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61612025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61622025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
61632025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61642025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61652025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
61662025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61672025-05-22T21:22:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 229422095 } })
61682025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61692025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
61702025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61712025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61722025-05-22T21:22:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61732025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
61742025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61752025-05-22T21:22:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 229637848 } })
61762025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61772025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61782025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61792025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61802025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61812025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
61822025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 6 reason = Timeout
61832025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
61842025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61852025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61862025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
61872025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61882025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61892025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
61902025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61912025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61922025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
61932025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
61942025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61952025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61962025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
61972025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61982025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.018815ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
61992025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
62002025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
62012025-05-22T21:22:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.509262ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
62022025-05-22T21:22:35.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.398546ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62032025-05-22T21:22:35.091ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62042025-05-22T21:22:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62052025-05-22T21:22:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 8.305054ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
62062025-05-22T21:22:35.093ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
62072025-05-22T21:22:35.093ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
62082025-05-22T21:22:35.093ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 8.359864ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
62092025-05-22T21:22:35.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62102025-05-22T21:22:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62112025-05-22T21:22:35.096ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62122025-05-22T21:22:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62132025-05-22T21:22:35.096ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 240450719 } })
62142025-05-22T21:22:35.097ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152025-05-22T21:22:35.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
62162025-05-22T21:22:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62172025-05-22T21:22:35.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62182025-05-22T21:22:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62192025-05-22T21:22:35.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62202025-05-22T21:22:35.104ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:12:35.085193983 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
62212025-05-22T21:22:35.104ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.656902ms iteration = 6 status = {"expiration":"2025-05-22T21:12:35.085193983Z","pruned":[]}
62222025-05-22T21:22:35.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62232025-05-22T21:22:35.105ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 249500593 } })
62242025-05-22T21:22:35.106ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
62252025-05-22T21:22:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
62262025-05-22T21:22:35.107ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
62272025-05-22T21:22:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
62282025-05-22T21:22:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62292025-05-22T21:22:35.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62302025-05-22T21:22:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62312025-05-22T21:22:35.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62322025-05-22T21:22:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62332025-05-22T21:22:35.115ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62342025-05-22T21:22:35.115ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62352025-05-22T21:22:35.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62362025-05-22T21:22:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62372025-05-22T21:22:35.119ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
62382025-05-22T21:22:35.120ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 33.890124ms iteration = 6 status = {"by_rx":{},"error":null}
62392025-05-22T21:22:35.125ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
62402025-05-22T21:22:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
62412025-05-22T21:22:35.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62422025-05-22T21:22:35.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62432025-05-22T21:22:35.140ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62442025-05-22T21:22:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62452025-05-22T21:22:35.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62462025-05-22T21:22:35.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62472025-05-22T21:22:35.171ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482025-05-22T21:22:35.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-05-22T21:22:35.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
62502025-05-22T21:22:35.173ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62512025-05-22T21:22:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
62522025-05-22T21:22:35.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62532025-05-22T21:22:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62542025-05-22T21:22:35.176ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62552025-05-22T21:22:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62562025-05-22T21:22:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62572025-05-22T21:22:35.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62582025-05-22T21:22:35.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62592025-05-22T21:22:35.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62602025-05-22T21:22:35.179ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1264, tv_nsec: 323079908 } })
62612025-05-22T21:22:35.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62622025-05-22T21:22:35.179ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
62632025-05-22T21:22:35.180ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62642025-05-22T21:22:35.183ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 98.070089ms iteration = 6 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
62652025-05-22T21:22:35.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62662025-05-22T21:22:35.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62672025-05-22T21:22:35.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62682025-05-22T21:22:35.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62692025-05-22T21:22:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62702025-05-22T21:22:35.185ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 99.574932ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
62712025-05-22T21:22:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62722025-05-22T21:22:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
62732025-05-22T21:22:35.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62742025-05-22T21:22:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62752025-05-22T21:22:35.187ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62762025-05-22T21:22:35.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62772025-05-22T21:22:35.187ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62782025-05-22T21:22:35.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62792025-05-22T21:22:35.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62802025-05-22T21:22:35.188ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62812025-05-22T21:22:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62822025-05-22T21:22:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62832025-05-22T21:22:35.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62842025-05-22T21:22:35.189ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62852025-05-22T21:22:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62862025-05-22T21:22:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 107.103134ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
62872025-05-22T21:22:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 107.887895ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62882025-05-22T21:22:35.194ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62892025-05-22T21:22:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62902025-05-22T21:22:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62912025-05-22T21:22:35.194ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62922025-05-22T21:22:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62932025-05-22T21:22:35.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 109.736183ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
62942025-05-22T21:22:35.195ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952025-05-22T21:22:35.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62962025-05-22T21:22:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62972025-05-22T21:22:35.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
62982025-05-22T21:22:35.199ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
62992025-05-22T21:22:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
63002025-05-22T21:22:35.205ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63012025-05-22T21:22:35.205ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63022025-05-22T21:22:35.206ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63032025-05-22T21:22:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63042025-05-22T21:22:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63052025-05-22T21:22:35.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.916064ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63062025-05-22T21:22:35.208ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63072025-05-22T21:22:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63082025-05-22T21:22:35.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63092025-05-22T21:22:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63102025-05-22T21:22:35.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112025-05-22T21:22:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
63122025-05-22T21:22:35.216ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
63132025-05-22T21:22:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
63142025-05-22T21:22:35.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63152025-05-22T21:22:35.221ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
63162025-05-22T21:22:35.221ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
63172025-05-22T21:22:35.221ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
63182025-05-22T21:22:35.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63192025-05-22T21:22:35.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63202025-05-22T21:22:35.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
63212025-05-22T21:22:35.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
63222025-05-22T21:22:35.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
63232025-05-22T21:22:35.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63242025-05-22T21:22:35.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63252025-05-22T21:22:35.227ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63262025-05-22T21:22:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
63272025-05-22T21:22:35.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
63282025-05-22T21:22:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
63292025-05-22T21:22:35.242ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
63302025-05-22T21:22:35.243ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
63312025-05-22T21:22:35.243ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 157.471084ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
63322025-05-22T21:22:35.248ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63332025-05-22T21:22:35.248ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63342025-05-22T21:22:35.248ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63352025-05-22T21:22:35.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63362025-05-22T21:22:35.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63372025-05-22T21:22:35.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63382025-05-22T21:22:35.259ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
63392025-05-22T21:22:35.259ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 173.691915ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
63402025-05-22T21:22:35.262ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63412025-05-22T21:22:35.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63422025-05-22T21:22:35.265ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63432025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63442025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63452025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63462025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
63472025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
63482025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
63492025-05-22T21:22:35.266ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63502025-05-22T21:22:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63512025-05-22T21:22:35.267ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63522025-05-22T21:22:35.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63532025-05-22T21:22:35.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63542025-05-22T21:22:35.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63552025-05-22T21:22:35.269ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63562025-05-22T21:22:35.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63572025-05-22T21:22:35.269ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63582025-05-22T21:22:35.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63592025-05-22T21:22:35.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63602025-05-22T21:22:35.272ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
63612025-05-22T21:22:35.272ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63622025-05-22T21:22:35.272ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f12e31b-a169-4556-a207-d36c5d487641", "content-length": "26", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
63632025-05-22T21:22:35.272ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63642025-05-22T21:22:35.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
63652025-05-22T21:22:35.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63662025-05-22T21:22:35.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63672025-05-22T21:22:35.273ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63682025-05-22T21:22:35.273ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63692025-05-22T21:22:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63702025-05-22T21:22:35.275ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.627202ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63712025-05-22T21:22:35.275ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63722025-05-22T21:22:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63732025-05-22T21:22:35.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63742025-05-22T21:22:35.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63752025-05-22T21:22:35.279ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63762025-05-22T21:22:35.282ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63772025-05-22T21:22:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
63782025-05-22T21:22:35.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63792025-05-22T21:22:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63802025-05-22T21:22:35.285ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
63812025-05-22T21:22:35.285ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63822025-05-22T21:22:35.285ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4c60068-489b-4dc0-9072-f18d930a6161", "content-length": "26", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
63832025-05-22T21:22:35.285ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63842025-05-22T21:22:35.286ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
63852025-05-22T21:22:35.286ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63862025-05-22T21:22:35.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
63872025-05-22T21:22:35.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63882025-05-22T21:22:35.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63892025-05-22T21:22:35.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63902025-05-22T21:22:35.292ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63912025-05-22T21:22:35.292ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 206.479963ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63922025-05-22T21:22:35.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63932025-05-22T21:22:35.293ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 207.709082ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63942025-05-22T21:22:35.294ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 208.836618ms iteration = 11 status = 0
63952025-05-22T21:22:35.295ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
63962025-05-22T21:22:35.295ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63972025-05-22T21:22:35.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63982025-05-22T21:22:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63992025-05-22T21:22:35.296ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64002025-05-22T21:22:35.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
64012025-05-22T21:22:35.299ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
64022025-05-22T21:22:35.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
64032025-05-22T21:22:35.299ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64042025-05-22T21:22:35.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64052025-05-22T21:22:35.302ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64062025-05-22T21:22:35.302ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64072025-05-22T21:22:35.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64082025-05-22T21:22:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
64092025-05-22T21:22:35.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
64102025-05-22T21:22:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
64112025-05-22T21:22:35.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64122025-05-22T21:22:35.308ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64132025-05-22T21:22:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64142025-05-22T21:22:35.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
64152025-05-22T21:22:35.315ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64162025-05-22T21:22:35.315ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
64172025-05-22T21:22:35.315ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
64182025-05-22T21:22:35.315ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64192025-05-22T21:22:35.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64202025-05-22T21:22:35.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
64212025-05-22T21:22:35.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
64222025-05-22T21:22:35.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
64232025-05-22T21:22:35.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 230.949036ms iteration = 6 status = {"generation":1}
64242025-05-22T21:22:35.318ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64252025-05-22T21:22:35.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
64262025-05-22T21:22:35.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64272025-05-22T21:22:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
64282025-05-22T21:22:35.322ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
64292025-05-22T21:22:35.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
64302025-05-22T21:22:35.322ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64312025-05-22T21:22:35.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
64322025-05-22T21:22:35.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64332025-05-22T21:22:35.326ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64342025-05-22T21:22:35.329ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64352025-05-22T21:22:35.329ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64362025-05-22T21:22:35.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64372025-05-22T21:22:35.329ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64382025-05-22T21:22:35.329ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
64392025-05-22T21:22:35.329ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 244.347386ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
64402025-05-22T21:22:35.330ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
64412025-05-22T21:22:35.330ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
64422025-05-22T21:22:35.330ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
64432025-05-22T21:22:35.330ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 244.820633ms iteration = 6 status = {"generation":2}
64442025-05-22T21:22:35.335ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64452025-05-22T21:22:35.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64462025-05-22T21:22:35.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64472025-05-22T21:22:35.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64482025-05-22T21:22:35.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64492025-05-22T21:22:35.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64502025-05-22T21:22:35.350ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
64512025-05-22T21:22:35.350ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
64522025-05-22T21:22:35.350ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "23014aa4-a914-4b45-a054-1833e409e9b5", "content-length": "26", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
64532025-05-22T21:22:35.350ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
64542025-05-22T21:22:35.352ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
64552025-05-22T21:22:35.354ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
64562025-05-22T21:22:35.354ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 269.577651ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
64572025-05-22T21:22:35.381ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64582025-05-22T21:22:35.384ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64592025-05-22T21:22:35.384ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64602025-05-22T21:22:35.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64612025-05-22T21:22:35.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc2810c1-e1aa-4462-953d-2f87acf8ce34 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
64622025-05-22T21:22:35.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc2810c1-e1aa-4462-953d-2f87acf8ce34 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
64632025-05-22T21:22:35.448ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64642025-05-22T21:22:35.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64652025-05-22T21:22:35.452ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
64662025-05-22T21:22:35.452ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 367.116534ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
64672025-05-22T21:22:35.454ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 368.563225ms iteration = 13 status = {"physical_disks_added":0}
64682025-05-22T21:22:35.481ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
64692025-05-22T21:22:35.496ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
64702025-05-22T21:22:35.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ea8b982e-009a-439a-9b92-944187abfbe7", "date": "Thu, 22 May 2025 21:22:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64712025-05-22T21:22:35.496ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64722025-05-22T21:22:35.498ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4daa5516-a472-4bde-a423-9e3ed8bc81a2", "date": "Thu, 22 May 2025 21:22:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64732025-05-22T21:22:35.498ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64742025-05-22T21:22:35.500ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
64752025-05-22T21:22:35.500ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 414.892135ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
64762025-05-22T21:22:35.505ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
64772025-05-22T21:22:35.505ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 419.939939ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
64782025-05-22T21:22:35.521ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64792025-05-22T21:22:35.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64802025-05-22T21:22:35.571ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 485.900701ms iteration = 11 status = {}
64812025-05-22T21:22:35.577ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
64822025-05-22T21:22:35.577ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64832025-05-22T21:22:35.578ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1c0ef53-c341-473e-b61a-3e1db6d404e9", "content-length": "372", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
64842025-05-22T21:22:35.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64852025-05-22T21:22:35.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64862025-05-22T21:22:35.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 149961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc2810c1-e1aa-4462-953d-2f87acf8ce34 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
64872025-05-22T21:22:35.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64882025-05-22T21:22:35.590ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892025-05-22T21:22:35.592ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64902025-05-22T21:22:35.592ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.423721ms iteration = 11 status = null
64912025-05-22T21:22:35.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64922025-05-22T21:22:35.595ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
64932025-05-22T21:22:35.595ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64942025-05-22T21:22:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
64952025-05-22T21:22:35.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64962025-05-22T21:22:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64972025-05-22T21:22:35.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64982025-05-22T21:22:35.598ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64992025-05-22T21:22:35.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65002025-05-22T21:22:35.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65012025-05-22T21:22:35.600ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65022025-05-22T21:22:35.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65032025-05-22T21:22:35.601ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65042025-05-22T21:22:35.604ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65052025-05-22T21:22:35.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65062025-05-22T21:22:35.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65072025-05-22T21:22:35.612ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65082025-05-22T21:22:35.613ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65092025-05-22T21:22:35.617ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65102025-05-22T21:22:35.618ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
65112025-05-22T21:22:35.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65122025-05-22T21:22:35.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65132025-05-22T21:22:35.620ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65142025-05-22T21:22:35.620ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65152025-05-22T21:22:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65162025-05-22T21:22:35.620ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
65172025-05-22T21:22:35.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
65182025-05-22T21:22:35.621ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
65192025-05-22T21:22:35.622ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "62e54ded-7e1a-4e36-83ff-81392861de9a", "date": "Thu, 22 May 2025 21:22:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65202025-05-22T21:22:35.622ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65212025-05-22T21:22:35.622ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65222025-05-22T21:22:35.622ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65232025-05-22T21:22:35.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65242025-05-22T21:22:35.624ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9571804a-dbab-4243-a4a8-41a375f6fcfd", "date": "Thu, 22 May 2025 21:22:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65252025-05-22T21:22:35.624ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65262025-05-22T21:22:35.624ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65272025-05-22T21:22:35.624ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65282025-05-22T21:22:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65292025-05-22T21:22:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65302025-05-22T21:22:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
65312025-05-22T21:22:35.625ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
65322025-05-22T21:22:35.625ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
65332025-05-22T21:22:35.627ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "67ed86e0-3978-4aec-b7b5-c4e0d82e8655", "date": "Thu, 22 May 2025 21:22:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65342025-05-22T21:22:35.627ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65352025-05-22T21:22:35.627ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65362025-05-22T21:22:35.627ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65372025-05-22T21:22:35.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65382025-05-22T21:22:35.629ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
65392025-05-22T21:22:35.629ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65402025-05-22T21:22:35.629ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
65412025-05-22T21:22:35.629ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 544.263109ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
65422025-05-22T21:22:35.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65432025-05-22T21:22:35.630ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65442025-05-22T21:22:35.630ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65452025-05-22T21:22:35.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65462025-05-22T21:22:35.632ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "ecc3873a-e7bc-4ad0-af58-875d59629e2d", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
65472025-05-22T21:22:35.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65482025-05-22T21:22:35.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65492025-05-22T21:22:35.635ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
65502025-05-22T21:22:35.635ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65512025-05-22T21:22:35.635ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e3129a-d8ee-4bb7-afbc-3fdbf1f84a64", "content-length": "26", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
65522025-05-22T21:22:35.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65532025-05-22T21:22:35.636ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65542025-05-22T21:22:35.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65552025-05-22T21:22:35.637ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65562025-05-22T21:22:35.638ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
65572025-05-22T21:22:35.638ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65582025-05-22T21:22:35.641ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 555.959774ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:22:35.632669660Z"},{"operation":"list","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:22:35.638663770Z"}]}
65592025-05-22T21:22:35.641ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65602025-05-22T21:22:35.641ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65612025-05-22T21:22:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
65622025-05-22T21:22:35.642ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65632025-05-22T21:22:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65642025-05-22T21:22:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65652025-05-22T21:22:35.645ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65662025-05-22T21:22:35.645ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65672025-05-22T21:22:35.646ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65682025-05-22T21:22:35.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65692025-05-22T21:22:35.655ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702025-05-22T21:22:35.656ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65712025-05-22T21:22:35.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65722025-05-22T21:22:35.658ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65732025-05-22T21:22:35.658ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65742025-05-22T21:22:35.659ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65752025-05-22T21:22:35.660ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65762025-05-22T21:22:35.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65772025-05-22T21:22:35.664ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65782025-05-22T21:22:35.664ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65792025-05-22T21:22:35.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65802025-05-22T21:22:35.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65812025-05-22T21:22:35.666ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65822025-05-22T21:22:35.666ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65832025-05-22T21:22:35.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65842025-05-22T21:22:35.670ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65852025-05-22T21:22:35.670ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65862025-05-22T21:22:35.670ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65872025-05-22T21:22:35.674ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65882025-05-22T21:22:35.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65892025-05-22T21:22:35.677ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65902025-05-22T21:22:35.677ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65912025-05-22T21:22:35.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65922025-05-22T21:22:35.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65932025-05-22T21:22:35.679ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65942025-05-22T21:22:35.683ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
65952025-05-22T21:22:35.684ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
65962025-05-22T21:22:35.684ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65972025-05-22T21:22:35.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65982025-05-22T21:22:35.686ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
65992025-05-22T21:22:35.686ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
66002025-05-22T21:22:35.686ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "59c9b5f0-56ee-4857-858f-36624bde173a", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
66012025-05-22T21:22:35.686ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66022025-05-22T21:22:35.687ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 601.910148ms iteration = 4 status = {"blueprint_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","inventory_collection_id":"6ab0bcf6-1fbb-4715-8c4b-36966aa111ba","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":3,"num_already_tombstoned":0,"num_inserted":6,"num_not_in_inventory":0,"num_tombstoned":0}}}
66032025-05-22T21:22:35.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66042025-05-22T21:22:35.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66052025-05-22T21:22:35.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66062025-05-22T21:22:35.689ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66072025-05-22T21:22:35.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66082025-05-22T21:22:35.691ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66092025-05-22T21:22:35.692ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66102025-05-22T21:22:35.692ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66112025-05-22T21:22:35.696ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66122025-05-22T21:22:35.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66132025-05-22T21:22:35.699ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
66142025-05-22T21:22:35.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66152025-05-22T21:22:35.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66162025-05-22T21:22:35.702ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
66172025-05-22T21:22:35.702ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
66182025-05-22T21:22:35.702ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a62cc5ef-a8d8-476f-8fc3-0a1894714ba0", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
66192025-05-22T21:22:35.702ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66202025-05-22T21:22:35.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66212025-05-22T21:22:35.705ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
66222025-05-22T21:22:35.705ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66232025-05-22T21:22:35.705ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 620.459193ms iteration = 11 status = {}
66242025-05-22T21:22:35.706ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66252025-05-22T21:22:35.709ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66262025-05-22T21:22:35.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66272025-05-22T21:22:35.712ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66282025-05-22T21:22:35.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66292025-05-22T21:22:35.714ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66302025-05-22T21:22:35.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66312025-05-22T21:22:35.715ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66322025-05-22T21:22:35.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66332025-05-22T21:22:35.717ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66342025-05-22T21:22:35.718ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66352025-05-22T21:22:35.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66362025-05-22T21:22:35.719ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66372025-05-22T21:22:35.719ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66382025-05-22T21:22:35.719ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66392025-05-22T21:22:35.720ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
66402025-05-22T21:22:35.720ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
66412025-05-22T21:22:35.721ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
66432025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
66442025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66452025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66462025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66472025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66482025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
66492025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
66502025-05-22T21:22:35.721ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66512025-05-22T21:22:35.721ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
66522025-05-22T21:22:35.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66532025-05-22T21:22:35.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66542025-05-22T21:22:35.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66552025-05-22T21:22:35.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
66562025-05-22T21:22:35.724ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
66572025-05-22T21:22:35.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
66582025-05-22T21:22:35.726ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
66592025-05-22T21:22:35.726ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66602025-05-22T21:22:35.728ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66612025-05-22T21:22:35.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66622025-05-22T21:22:35.781ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66632025-05-22T21:22:35.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66642025-05-22T21:22:35.783ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66652025-05-22T21:22:35.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
66662025-05-22T21:22:35.787ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66672025-05-22T21:22:35.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66682025-05-22T21:22:35.789ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66692025-05-22T21:22:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66702025-05-22T21:22:35.791ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66712025-05-22T21:22:35.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66722025-05-22T21:22:35.794ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66732025-05-22T21:22:35.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
66742025-05-22T21:22:35.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66752025-05-22T21:22:35.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66762025-05-22T21:22:35.805ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
66772025-05-22T21:22:35.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66782025-05-22T21:22:35.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66792025-05-22T21:22:35.807ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66802025-05-22T21:22:35.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
66812025-05-22T21:22:35.811ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
66822025-05-22T21:22:35.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
66832025-05-22T21:22:35.814ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
66842025-05-22T21:22:35.814ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
66852025-05-22T21:22:35.814ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
66862025-05-22T21:22:35.879ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
66872025-05-22T21:22:35.884ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "abd0a2d5-1399-4aa3-8dc4-3a28d4805fd4", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
66882025-05-22T21:22:35.884ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
66892025-05-22T21:22:35.884ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66902025-05-22T21:22:35.885ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "78cc5dc2-ebc4-40cf-8ec2-a5023a4bfeff", "content-length": "682", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
66912025-05-22T21:22:35.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66922025-05-22T21:22:35.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66932025-05-22T21:22:35.885ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "647d2205-0c0f-43d4-a6b6-f8f041513557", "content-length": "691", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
66942025-05-22T21:22:35.885ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
66952025-05-22T21:22:35.885ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
66962025-05-22T21:22:35.885ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
66972025-05-22T21:22:35.888ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 803.129192ms iteration = 11 status = {}
66982025-05-22T21:22:35.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66992025-05-22T21:22:35.890ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, time_created: 2025-05-22T21:17:45.513933Z, time_modified: 2025-05-22T21:17:45.513933Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
67002025-05-22T21:22:35.890ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
67012025-05-22T21:22:35.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67022025-05-22T21:22:35.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67032025-05-22T21:22:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67042025-05-22T21:22:35.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67052025-05-22T21:22:35.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67062025-05-22T21:22:35.907ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 822.122614ms iteration = 11 status = {}
67072025-05-22T21:22:35.934ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67082025-05-22T21:22:35.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67092025-05-22T21:22:35.937ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
67102025-05-22T21:22:35.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
67112025-05-22T21:22:35.939ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67122025-05-22T21:22:35.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
67132025-05-22T21:22:35.943ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
67142025-05-22T21:22:35.947ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "298a6da1-37f2-4892-8b9c-a8f188b1e2bf", "date": "Thu, 22 May 2025 21:22:35 GMT"} })
67152025-05-22T21:22:35.948ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
67162025-05-22T21:22:35.948ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 863.632132ms
67172025-05-22T21:22:35.948ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 863.642652ms iteration = 2 status = {}
67182025-05-22T21:22:36.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f582cf0e-ac28-4b82-b63a-e6843ddf640a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67192025-05-22T21:22:36.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f582cf0e-ac28-4b82-b63a-e6843ddf640a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67202025-05-22T21:22:36.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f582cf0e-ac28-4b82-b63a-e6843ddf640a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67212025-05-22T21:22:37.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c7ee2a76-c250-4426-bba0-113b0b497726 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67222025-05-22T21:22:37.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c7ee2a76-c250-4426-bba0-113b0b497726 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67232025-05-22T21:22:37.619ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c7ee2a76-c250-4426-bba0-113b0b497726 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67242025-05-22T21:22:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 578 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 1612d7b9-18a6-4b63-93aa-dcda704b7936 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
67252025-05-22T21:22:38.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4ac8e7ba-1e18-4e9d-bcfb-65fa2441b82b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67262025-05-22T21:22:38.632ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4ac8e7ba-1e18-4e9d-bcfb-65fa2441b82b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67272025-05-22T21:22:38.634ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4ac8e7ba-1e18-4e9d-bcfb-65fa2441b82b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67282025-05-22T21:22:39.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c78b84f-acff-48de-ac4b-57daf6e89b40 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67292025-05-22T21:22:39.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c78b84f-acff-48de-ac4b-57daf6e89b40 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67302025-05-22T21:22:39.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c78b84f-acff-48de-ac4b-57daf6e89b40 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67312025-05-22T21:22:40.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e89e48c1-66fd-487e-a31a-db7e16189d52 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67322025-05-22T21:22:40.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e89e48c1-66fd-487e-a31a-db7e16189d52 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67332025-05-22T21:22:40.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2755 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e89e48c1-66fd-487e-a31a-db7e16189d52 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67342025-05-22T21:22:41.680ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4335c3e-dca9-45f7-925f-84250672bd33 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67352025-05-22T21:22:41.680ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4335c3e-dca9-45f7-925f-84250672bd33 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67362025-05-22T21:22:41.682ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4335c3e-dca9-45f7-925f-84250672bd33 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67372025-05-22T21:22:42.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 937b711a-46d3-4b8a-b286-7c4ab5fa9b64 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67382025-05-22T21:22:42.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 937b711a-46d3-4b8a-b286-7c4ab5fa9b64 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67392025-05-22T21:22:42.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 937b711a-46d3-4b8a-b286-7c4ab5fa9b64 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67402025-05-22T21:22:43.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a018dfd6-dd85-418d-8ad7-aa714268c4cd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67412025-05-22T21:22:43.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a018dfd6-dd85-418d-8ad7-aa714268c4cd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67422025-05-22T21:22:43.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1724 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a018dfd6-dd85-418d-8ad7-aa714268c4cd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67432025-05-22T21:22:44.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddc67cc5-a9b6-4931-aa4c-c759912a76c0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67442025-05-22T21:22:44.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddc67cc5-a9b6-4931-aa4c-c759912a76c0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67452025-05-22T21:22:44.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2293 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddc67cc5-a9b6-4931-aa4c-c759912a76c0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67462025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
67472025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
67482025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67492025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67502025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67512025-05-22T21:22:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67522025-05-22T21:22:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67532025-05-22T21:22:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67542025-05-22T21:22:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67552025-05-22T21:22:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67562025-05-22T21:22:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67572025-05-22T21:22:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67582025-05-22T21:22:45.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67592025-05-22T21:22:45.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
67602025-05-22T21:22:45.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67612025-05-22T21:22:45.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67622025-05-22T21:22:45.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
67632025-05-22T21:22:45.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.702193ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
67642025-05-22T21:22:45.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67652025-05-22T21:22:45.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67662025-05-22T21:22:45.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.124529ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
67672025-05-22T21:22:45.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e448d7ef-5c03-4e43-b9f9-6751c9acf5f8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67682025-05-22T21:22:45.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e448d7ef-5c03-4e43-b9f9-6751c9acf5f8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67692025-05-22T21:22:45.744ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e448d7ef-5c03-4e43-b9f9-6751c9acf5f8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67702025-05-22T21:22:46.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d1d50-1858-427c-8160-ade74ebe2042 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67712025-05-22T21:22:46.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d1d50-1858-427c-8160-ade74ebe2042 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67722025-05-22T21:22:46.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d1d50-1858-427c-8160-ade74ebe2042 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67732025-05-22T21:22:47.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16d2a23c-eaa4-472a-a137-cb08a5b7693a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67742025-05-22T21:22:47.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16d2a23c-eaa4-472a-a137-cb08a5b7693a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67752025-05-22T21:22:47.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16d2a23c-eaa4-472a-a137-cb08a5b7693a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67762025-05-22T21:22:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 546 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = e3a30375-b685-4e46-972d-9f3fd2b6f1d5 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
67772025-05-22T21:22:48.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52ba64cf-b92f-4f43-b42d-584451c2910c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67782025-05-22T21:22:48.791ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52ba64cf-b92f-4f43-b42d-584451c2910c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67792025-05-22T21:22:48.793ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 52ba64cf-b92f-4f43-b42d-584451c2910c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67802025-05-22T21:22:49.806ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45cf487e-f24b-4fe5-8791-4802ef7d7a90 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67812025-05-22T21:22:49.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45cf487e-f24b-4fe5-8791-4802ef7d7a90 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67822025-05-22T21:22:49.808ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45cf487e-f24b-4fe5-8791-4802ef7d7a90 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67832025-05-22T21:22:50.823ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9c7279c0-e1ad-412f-be61-7d4ee474e806 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67842025-05-22T21:22:50.823ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9c7279c0-e1ad-412f-be61-7d4ee474e806 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67852025-05-22T21:22:50.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2225 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9c7279c0-e1ad-412f-be61-7d4ee474e806 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67862025-05-22T21:22:51.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5c6a567-1a9a-4dee-a179-8c8380745301 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67872025-05-22T21:22:51.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5c6a567-1a9a-4dee-a179-8c8380745301 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67882025-05-22T21:22:51.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5c6a567-1a9a-4dee-a179-8c8380745301 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67892025-05-22T21:22:52.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 827da927-753d-47c4-a780-1822f57aa661 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67902025-05-22T21:22:52.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 827da927-753d-47c4-a780-1822f57aa661 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67912025-05-22T21:22:52.856ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1610 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 827da927-753d-47c4-a780-1822f57aa661 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67922025-05-22T21:22:53.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06dcb09d-d41f-4d9f-8f91-f65e4ea56883 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67932025-05-22T21:22:53.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06dcb09d-d41f-4d9f-8f91-f65e4ea56883 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67942025-05-22T21:22:53.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2170 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06dcb09d-d41f-4d9f-8f91-f65e4ea56883 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67952025-05-22T21:22:54.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8bcf17d9-722f-4273-ab53-9d47d9fb51c1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67962025-05-22T21:22:54.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8bcf17d9-722f-4273-ab53-9d47d9fb51c1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67972025-05-22T21:22:54.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8bcf17d9-722f-4273-ab53-9d47d9fb51c1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
67982025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
67992025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
68002025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68012025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68022025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68032025-05-22T21:22:55.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68042025-05-22T21:22:55.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68052025-05-22T21:22:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68062025-05-22T21:22:55.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68072025-05-22T21:22:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68082025-05-22T21:22:55.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68092025-05-22T21:22:55.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68102025-05-22T21:22:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68112025-05-22T21:22:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
68122025-05-22T21:22:55.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68132025-05-22T21:22:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68142025-05-22T21:22:55.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
68152025-05-22T21:22:55.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.582931ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
68162025-05-22T21:22:55.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68172025-05-22T21:22:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68182025-05-22T21:22:55.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.110493ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68192025-05-22T21:22:55.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ad8c30a-0085-40a7-b335-a46609fec2a2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68202025-05-22T21:22:55.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ad8c30a-0085-40a7-b335-a46609fec2a2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68212025-05-22T21:22:55.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2137 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6ad8c30a-0085-40a7-b335-a46609fec2a2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68222025-05-22T21:22:56.917ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 719d028e-d6b7-4a08-9e67-4d274e2b2850 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68232025-05-22T21:22:56.918ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 719d028e-d6b7-4a08-9e67-4d274e2b2850 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68242025-05-22T21:22:56.919ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1792 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 719d028e-d6b7-4a08-9e67-4d274e2b2850 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68252025-05-22T21:22:57.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc8dfacd-8900-44f5-8758-3a9036ce2120 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68262025-05-22T21:22:57.933ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc8dfacd-8900-44f5-8758-3a9036ce2120 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68272025-05-22T21:22:57.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc8dfacd-8900-44f5-8758-3a9036ce2120 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68282025-05-22T21:22:58.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 453 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = deefa353-e464-4b6f-bded-7c068287d715 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
68292025-05-22T21:22:58.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a364ee6-0897-47d8-9eaa-8d5592df14fa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68302025-05-22T21:22:58.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a364ee6-0897-47d8-9eaa-8d5592df14fa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68312025-05-22T21:22:58.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a364ee6-0897-47d8-9eaa-8d5592df14fa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68322025-05-22T21:22:59.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07d8d52e-f154-4962-a216-d9ae15d50634 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68332025-05-22T21:22:59.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07d8d52e-f154-4962-a216-d9ae15d50634 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68342025-05-22T21:22:59.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 07d8d52e-f154-4962-a216-d9ae15d50634 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68352025-05-22T21:23:00.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21167b90-27c1-4318-9857-ac86ecd7a898 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68362025-05-22T21:23:00.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21167b90-27c1-4318-9857-ac86ecd7a898 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68372025-05-22T21:23:00.983ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 21167b90-27c1-4318-9857-ac86ecd7a898 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68382025-05-22T21:23:01.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0611f2b9-fdc5-42f4-8136-c588117700c8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68392025-05-22T21:23:01.996ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0611f2b9-fdc5-42f4-8136-c588117700c8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68402025-05-22T21:23:01.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0611f2b9-fdc5-42f4-8136-c588117700c8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68412025-05-22T21:23:03.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f877c398-089a-490f-8941-160505aabb3f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68422025-05-22T21:23:03.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f877c398-089a-490f-8941-160505aabb3f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68432025-05-22T21:23:03.015ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f877c398-089a-490f-8941-160505aabb3f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68442025-05-22T21:23:03.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = fda7e47b-413c-4873-9d66-e25070173701 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
68452025-05-22T21:23:03.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = fda7e47b-413c-4873-9d66-e25070173701 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
68462025-05-22T21:23:03.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = fda7e47b-413c-4873-9d66-e25070173701 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
68472025-05-22T21:23:03.155ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d9ccaceb-a471-4e77-ab4c-b783199c42e9 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
68482025-05-22T21:23:03.155ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d9ccaceb-a471-4e77-ab4c-b783199c42e9 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
68492025-05-22T21:23:03.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d9ccaceb-a471-4e77-ab4c-b783199c42e9 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
68502025-05-22T21:23:04.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caaca197-57b7-4e73-a621-68ab0f396a73 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68512025-05-22T21:23:04.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caaca197-57b7-4e73-a621-68ab0f396a73 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68522025-05-22T21:23:04.030ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caaca197-57b7-4e73-a621-68ab0f396a73 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68532025-05-22T21:23:05.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d764637f-7d1b-4d11-b12a-5438eec93329 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68542025-05-22T21:23:05.045ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d764637f-7d1b-4d11-b12a-5438eec93329 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68552025-05-22T21:23:05.047ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d764637f-7d1b-4d11-b12a-5438eec93329 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
68562025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
68572025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
68582025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68592025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68602025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
68612025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
68622025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
68632025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
68642025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
68652025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
68662025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
68672025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
68682025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
68692025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68702025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
68712025-05-22T21:23:05.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
68722025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
68732025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68742025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
68752025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68762025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68772025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
68782025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
68792025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68802025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68812025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
68822025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
68832025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68842025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
68852025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68862025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
68872025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68882025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
68892025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68902025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
68912025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
68922025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
68932025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
68942025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68952025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68962025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68972025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
68982025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68992025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69002025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69012025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69022025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69032025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69042025-05-22T21:23:05.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
69052025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69062025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69072025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69082025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69092025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69102025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69112025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69122025-05-22T21:23:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69132025-05-22T21:23:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69142025-05-22T21:23:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69152025-05-22T21:23:05.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69162025-05-22T21:23:05.088ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69172025-05-22T21:23:05.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.084406ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69182025-05-22T21:23:05.090ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69192025-05-22T21:23:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69202025-05-22T21:23:05.091ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69212025-05-22T21:23:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69222025-05-22T21:23:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69232025-05-22T21:23:05.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69242025-05-22T21:23:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69252025-05-22T21:23:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69262025-05-22T21:23:05.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69272025-05-22T21:23:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69282025-05-22T21:23:05.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 240832362 } })
69292025-05-22T21:23:05.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
69302025-05-22T21:23:05.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69312025-05-22T21:23:05.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69322025-05-22T21:23:05.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 243944509 } })
69332025-05-22T21:23:05.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
69342025-05-22T21:23:05.101ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69352025-05-22T21:23:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69362025-05-22T21:23:05.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69372025-05-22T21:23:05.101ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69382025-05-22T21:23:05.101ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
69392025-05-22T21:23:05.101ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69402025-05-22T21:23:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69412025-05-22T21:23:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69422025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69432025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69442025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69452025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69462025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69472025-05-22T21:23:05.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69482025-05-22T21:23:05.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69492025-05-22T21:23:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69502025-05-22T21:23:05.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1294, tv_nsec: 256820360 } })
69512025-05-22T21:23:05.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69522025-05-22T21:23:05.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
69532025-05-22T21:23:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69542025-05-22T21:23:05.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69552025-05-22T21:23:05.118ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
69562025-05-22T21:23:05.118ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 34.159498ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
69572025-05-22T21:23:05.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
69582025-05-22T21:23:05.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69592025-05-22T21:23:05.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69602025-05-22T21:23:05.143ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 59.062399ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
69612025-05-22T21:23:05.146ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69622025-05-22T21:23:05.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69632025-05-22T21:23:05.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.82585ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
69642025-05-22T21:23:05.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69652025-05-22T21:23:05.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69662025-05-22T21:23:05.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69672025-05-22T21:23:05.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69682025-05-22T21:23:05.151ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 67.045867ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
69692025-05-22T21:23:05.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69702025-05-22T21:23:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69712025-05-22T21:23:05.153ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
69722025-05-22T21:23:05.153ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 69.23645ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
69732025-05-22T21:23:05.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69742025-05-22T21:23:05.155ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69752025-05-22T21:23:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69762025-05-22T21:23:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
69772025-05-22T21:23:05.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69782025-05-22T21:23:05.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69792025-05-22T21:23:05.159ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.503234ms iteration = 12 status = 0
69802025-05-22T21:23:05.161ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69812025-05-22T21:23:05.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69822025-05-22T21:23:05.162ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69832025-05-22T21:23:05.163ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 79.264539ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
69842025-05-22T21:23:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69852025-05-22T21:23:05.164ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69862025-05-22T21:23:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69872025-05-22T21:23:05.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.380216ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
69882025-05-22T21:23:05.167ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69892025-05-22T21:23:05.167ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
69902025-05-22T21:23:05.167ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69912025-05-22T21:23:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69922025-05-22T21:23:05.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69932025-05-22T21:23:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69942025-05-22T21:23:05.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69952025-05-22T21:23:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69962025-05-22T21:23:05.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69972025-05-22T21:23:05.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69982025-05-22T21:23:05.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69992025-05-22T21:23:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70002025-05-22T21:23:05.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70012025-05-22T21:23:05.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70022025-05-22T21:23:05.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70032025-05-22T21:23:05.176ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70042025-05-22T21:23:05.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70052025-05-22T21:23:05.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
70062025-05-22T21:23:05.178ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70072025-05-22T21:23:05.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70082025-05-22T21:23:05.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 110.127708ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70092025-05-22T21:23:05.203ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
70102025-05-22T21:23:05.203ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 119.279765ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
70112025-05-22T21:23:05.203ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
70122025-05-22T21:23:05.203ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70132025-05-22T21:23:05.204ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69313d53-d3ef-4c85-8373-82ad95aa1701", "content-length": "26", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70142025-05-22T21:23:05.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70152025-05-22T21:23:05.205ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70162025-05-22T21:23:05.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 126.583353ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70172025-05-22T21:23:05.226ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70182025-05-22T21:23:05.226ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70192025-05-22T21:23:05.226ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 142.282757ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70202025-05-22T21:23:05.251ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70212025-05-22T21:23:05.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70222025-05-22T21:23:05.299ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 215.146181ms iteration = 14 status = {"physical_disks_added":0}
70232025-05-22T21:23:05.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
70242025-05-22T21:23:05.324ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70252025-05-22T21:23:05.324ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6400cc94-0ea8-4040-beb9-896a528def70", "content-length": "26", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70262025-05-22T21:23:05.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70272025-05-22T21:23:05.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70282025-05-22T21:23:05.359ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
70292025-05-22T21:23:05.359ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70302025-05-22T21:23:05.359ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a489d6bb-0afb-44fd-ae67-52751e2aa5b0", "content-length": "26", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70312025-05-22T21:23:05.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70322025-05-22T21:23:05.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
70332025-05-22T21:23:05.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70342025-05-22T21:23:05.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70352025-05-22T21:23:05.379ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70362025-05-22T21:23:05.379ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70372025-05-22T21:23:05.379ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e12a4abb-3a76-467d-a3a4-3eb7fb8f6b3a", "content-length": "372", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70382025-05-22T21:23:05.379ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70392025-05-22T21:23:05.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70402025-05-22T21:23:05.396ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
70412025-05-22T21:23:05.396ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70422025-05-22T21:23:05.397ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "333ef1ed-37fd-4aa8-97cc-af29d880c848", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70432025-05-22T21:23:05.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70442025-05-22T21:23:05.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70452025-05-22T21:23:05.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70462025-05-22T21:23:05.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70472025-05-22T21:23:05.402ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70482025-05-22T21:23:05.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70492025-05-22T21:23:05.406ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70502025-05-22T21:23:05.406ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70512025-05-22T21:23:05.406ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2f9996ac-fec6-4235-af52-5ad0520898b6", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70522025-05-22T21:23:05.407ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.437353ms iteration = 12 status = {}
70532025-05-22T21:23:05.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70542025-05-22T21:23:05.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70552025-05-22T21:23:05.416ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70562025-05-22T21:23:05.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70572025-05-22T21:23:05.428ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70582025-05-22T21:23:05.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70592025-05-22T21:23:05.430ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 346.162401ms iteration = 12 status = null
70602025-05-22T21:23:05.442ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 357.835404ms iteration = 12 status = {}
70612025-05-22T21:23:05.447ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70622025-05-22T21:23:05.449ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70632025-05-22T21:23:05.449ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70642025-05-22T21:23:05.449ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70652025-05-22T21:23:05.594ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70662025-05-22T21:23:05.595ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ec2dc0b-cd09-4499-ab68-61b2dc3e58c8", "content-length": "691", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70672025-05-22T21:23:05.595ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
70682025-05-22T21:23:05.595ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
70692025-05-22T21:23:05.595ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
70702025-05-22T21:23:05.598ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 513.808456ms iteration = 12 status = {}
70712025-05-22T21:23:05.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70722025-05-22T21:23:05.636ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70732025-05-22T21:23:05.638ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
70742025-05-22T21:23:05.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70752025-05-22T21:23:05.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70762025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
70772025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
70782025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
70792025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
70802025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70812025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70822025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70832025-05-22T21:23:05.648ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70842025-05-22T21:23:05.649ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
70852025-05-22T21:23:05.649ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
70862025-05-22T21:23:05.649ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
70872025-05-22T21:23:05.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70882025-05-22T21:23:05.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70892025-05-22T21:23:05.651ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
70902025-05-22T21:23:05.651ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
70912025-05-22T21:23:05.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "21cc0c6c-3ffa-4fac-b005-549785fca184", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70922025-05-22T21:23:05.755ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
70932025-05-22T21:23:05.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70942025-05-22T21:23:05.755ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "04de52ae-1124-48ec-909e-27d5126b41cd", "content-length": "682", "date": "Thu, 22 May 2025 21:23:05 GMT"} })
70952025-05-22T21:23:05.755ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70962025-05-22T21:23:05.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70972025-05-22T21:23:05.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70982025-05-22T21:23:05.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70992025-05-22T21:23:05.763ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71002025-05-22T21:23:05.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71012025-05-22T21:23:05.766ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71022025-05-22T21:23:05.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71032025-05-22T21:23:05.773ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.253116ms iteration = 12 status = {}
71042025-05-22T21:23:06.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b30995a7-c4ea-41b1-9be3-0cd5ccc605cf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71052025-05-22T21:23:06.063ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b30995a7-c4ea-41b1-9be3-0cd5ccc605cf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71062025-05-22T21:23:06.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b30995a7-c4ea-41b1-9be3-0cd5ccc605cf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71072025-05-22T21:23:07.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b53fafcf-1ce3-4498-92c5-92193720edfb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71082025-05-22T21:23:07.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b53fafcf-1ce3-4498-92c5-92193720edfb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71092025-05-22T21:23:07.081ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b53fafcf-1ce3-4498-92c5-92193720edfb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71102025-05-22T21:23:08.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cfb0cd84-976d-4c39-8f0e-d633827aed8f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71112025-05-22T21:23:08.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cfb0cd84-976d-4c39-8f0e-d633827aed8f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71122025-05-22T21:23:08.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2408 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cfb0cd84-976d-4c39-8f0e-d633827aed8f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71132025-05-22T21:23:08.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 542 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = e9c76064-1e06-4b50-91d1-5797e918fe01 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
71142025-05-22T21:23:09.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d848d646-3b16-479e-bc93-697ecd0703c7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71152025-05-22T21:23:09.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d848d646-3b16-479e-bc93-697ecd0703c7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71162025-05-22T21:23:09.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d848d646-3b16-479e-bc93-697ecd0703c7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71172025-05-22T21:23:10.127ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba274115-a07d-4df3-b8c7-2bd10ab71458 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71182025-05-22T21:23:10.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba274115-a07d-4df3-b8c7-2bd10ab71458 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71192025-05-22T21:23:10.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ba274115-a07d-4df3-b8c7-2bd10ab71458 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71202025-05-22T21:23:11.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c18e562-438c-4072-8e10-5e663ac6f8a8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71212025-05-22T21:23:11.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c18e562-438c-4072-8e10-5e663ac6f8a8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71222025-05-22T21:23:11.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1c18e562-438c-4072-8e10-5e663ac6f8a8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71232025-05-22T21:23:12.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bea0f870-bfd9-4ba0-84f9-1f7baeecb071 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71242025-05-22T21:23:12.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bea0f870-bfd9-4ba0-84f9-1f7baeecb071 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71252025-05-22T21:23:12.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bea0f870-bfd9-4ba0-84f9-1f7baeecb071 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71262025-05-22T21:23:13.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb6e998f-dee2-4fa9-9eae-8f79c63dc0f7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71272025-05-22T21:23:13.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb6e998f-dee2-4fa9-9eae-8f79c63dc0f7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71282025-05-22T21:23:13.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2616 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb6e998f-dee2-4fa9-9eae-8f79c63dc0f7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71292025-05-22T21:23:14.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7b819500-8bec-4bd7-88cd-be1c59cf32e0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71302025-05-22T21:23:14.193ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7b819500-8bec-4bd7-88cd-be1c59cf32e0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71312025-05-22T21:23:14.194ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7b819500-8bec-4bd7-88cd-be1c59cf32e0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71322025-05-22T21:23:15.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
71332025-05-22T21:23:15.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71342025-05-22T21:23:15.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
71352025-05-22T21:23:15.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71362025-05-22T21:23:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71372025-05-22T21:23:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71382025-05-22T21:23:15.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71392025-05-22T21:23:15.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71402025-05-22T21:23:15.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.123102ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71412025-05-22T21:23:15.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71422025-05-22T21:23:15.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71432025-05-22T21:23:15.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71442025-05-22T21:23:15.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71452025-05-22T21:23:15.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71462025-05-22T21:23:15.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71472025-05-22T21:23:15.130ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71482025-05-22T21:23:15.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
71492025-05-22T21:23:15.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71502025-05-22T21:23:15.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71512025-05-22T21:23:15.144ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
71522025-05-22T21:23:15.144ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 60.043104ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
71532025-05-22T21:23:15.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1584f1f0-ea55-454a-8837-7ca641f0e557 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71542025-05-22T21:23:15.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1584f1f0-ea55-454a-8837-7ca641f0e557 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71552025-05-22T21:23:15.210ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1584f1f0-ea55-454a-8837-7ca641f0e557 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71562025-05-22T21:23:16.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3995af93-8a99-45eb-bb75-c34fffebddb1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71572025-05-22T21:23:16.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3995af93-8a99-45eb-bb75-c34fffebddb1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71582025-05-22T21:23:16.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3995af93-8a99-45eb-bb75-c34fffebddb1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71592025-05-22T21:23:17.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ea24092-defb-4d39-8b0a-0b8e80e813ff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71602025-05-22T21:23:17.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ea24092-defb-4d39-8b0a-0b8e80e813ff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71612025-05-22T21:23:17.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9ea24092-defb-4d39-8b0a-0b8e80e813ff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71622025-05-22T21:23:18.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 478 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 12ce72c0-df4f-4642-b6bf-02f6445d5b36 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
71632025-05-22T21:23:18.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2867f55-f499-4858-8771-2d36131ac90e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71642025-05-22T21:23:18.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2867f55-f499-4858-8771-2d36131ac90e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71652025-05-22T21:23:18.255ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2867f55-f499-4858-8771-2d36131ac90e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71662025-05-22T21:23:19.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34fa8454-8788-4688-bb84-14796f6c5546 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71672025-05-22T21:23:19.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34fa8454-8788-4688-bb84-14796f6c5546 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71682025-05-22T21:23:19.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 34fa8454-8788-4688-bb84-14796f6c5546 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71692025-05-22T21:23:20.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28d2c893-e5c6-405b-9cf6-15a4787f531c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71702025-05-22T21:23:20.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28d2c893-e5c6-405b-9cf6-15a4787f531c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71712025-05-22T21:23:20.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28d2c893-e5c6-405b-9cf6-15a4787f531c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71722025-05-22T21:23:21.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed49fd19-6acb-4d96-853c-1cdd15bd242a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71732025-05-22T21:23:21.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed49fd19-6acb-4d96-853c-1cdd15bd242a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71742025-05-22T21:23:21.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2097 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed49fd19-6acb-4d96-853c-1cdd15bd242a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71752025-05-22T21:23:22.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14fdcd48-4da2-4cd1-a3d4-f7b07df49af3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71762025-05-22T21:23:22.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14fdcd48-4da2-4cd1-a3d4-f7b07df49af3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71772025-05-22T21:23:22.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 14fdcd48-4da2-4cd1-a3d4-f7b07df49af3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71782025-05-22T21:23:23.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b5c99846-5025-448e-a340-3e825e12936f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71792025-05-22T21:23:23.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b5c99846-5025-448e-a340-3e825e12936f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71802025-05-22T21:23:23.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b5c99846-5025-448e-a340-3e825e12936f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71812025-05-22T21:23:24.351ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a1bde6b-71de-485c-a0ae-05330bf72bfc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71822025-05-22T21:23:24.351ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a1bde6b-71de-485c-a0ae-05330bf72bfc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71832025-05-22T21:23:24.353ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2058 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6a1bde6b-71de-485c-a0ae-05330bf72bfc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
71842025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
71852025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
71862025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71872025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71882025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71892025-05-22T21:23:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71902025-05-22T21:23:25.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71912025-05-22T21:23:25.121ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71922025-05-22T21:23:25.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71932025-05-22T21:23:25.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71942025-05-22T21:23:25.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71952025-05-22T21:23:25.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71962025-05-22T21:23:25.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71972025-05-22T21:23:25.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71982025-05-22T21:23:25.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71992025-05-22T21:23:25.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
72002025-05-22T21:23:25.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72012025-05-22T21:23:25.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72022025-05-22T21:23:25.138ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
72032025-05-22T21:23:25.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.757675ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
72042025-05-22T21:23:25.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 66.708223ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
72052025-05-22T21:23:25.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed5eb826-a14d-4273-8782-734606cd9134 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72062025-05-22T21:23:25.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed5eb826-a14d-4273-8782-734606cd9134 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72072025-05-22T21:23:25.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed5eb826-a14d-4273-8782-734606cd9134 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72082025-05-22T21:23:26.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4bc1d1f8-de68-4fd2-a13d-1566b4163547 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72092025-05-22T21:23:26.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4bc1d1f8-de68-4fd2-a13d-1566b4163547 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72102025-05-22T21:23:26.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2391 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4bc1d1f8-de68-4fd2-a13d-1566b4163547 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72112025-05-22T21:23:27.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb8c87d-2eae-4e07-bd61-4ca75e88e169 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72122025-05-22T21:23:27.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb8c87d-2eae-4e07-bd61-4ca75e88e169 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72132025-05-22T21:23:27.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb8c87d-2eae-4e07-bd61-4ca75e88e169 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72142025-05-22T21:23:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 533 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 177a4752-0d2a-4aa6-b8d1-8a6539d08dbe response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
72152025-05-22T21:23:28.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ec5c15b-72c3-4115-85be-db4dd0a1d39b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72162025-05-22T21:23:28.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ec5c15b-72c3-4115-85be-db4dd0a1d39b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72172025-05-22T21:23:28.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ec5c15b-72c3-4115-85be-db4dd0a1d39b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72182025-05-22T21:23:29.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c00056a-2208-415d-8550-3d2754963ea4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72192025-05-22T21:23:29.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c00056a-2208-415d-8550-3d2754963ea4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72202025-05-22T21:23:29.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2375 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c00056a-2208-415d-8550-3d2754963ea4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72212025-05-22T21:23:30.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d72f7bb9-bf70-45a6-b42b-72ac62089e38 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72222025-05-22T21:23:30.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d72f7bb9-bf70-45a6-b42b-72ac62089e38 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72232025-05-22T21:23:30.450ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d72f7bb9-bf70-45a6-b42b-72ac62089e38 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72242025-05-22T21:23:31.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cda6233-0bfc-41c1-8096-f78bcf42ace3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72252025-05-22T21:23:31.464ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cda6233-0bfc-41c1-8096-f78bcf42ace3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72262025-05-22T21:23:31.466ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2382 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cda6233-0bfc-41c1-8096-f78bcf42ace3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72272025-05-22T21:23:32.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 716c3ec7-f6a5-469f-b269-ba10796ee0af roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72282025-05-22T21:23:32.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 716c3ec7-f6a5-469f-b269-ba10796ee0af resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72292025-05-22T21:23:32.481ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1665 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 716c3ec7-f6a5-469f-b269-ba10796ee0af response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72302025-05-22T21:23:33.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 688c188d-a258-438b-98f5-de7510188fd1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
72312025-05-22T21:23:33.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 688c188d-a258-438b-98f5-de7510188fd1 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
72322025-05-22T21:23:33.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3685 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 688c188d-a258-438b-98f5-de7510188fd1 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
72332025-05-22T21:23:33.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 5f57c398-24c7-4027-965f-b9d03061e72b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
72342025-05-22T21:23:33.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 5f57c398-24c7-4027-965f-b9d03061e72b resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
72352025-05-22T21:23:33.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 5f57c398-24c7-4027-965f-b9d03061e72b response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
72362025-05-22T21:23:33.494ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4cf2bb82-6a0d-47ed-ac54-ba0b4c2bceb8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72372025-05-22T21:23:33.495ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4cf2bb82-6a0d-47ed-ac54-ba0b4c2bceb8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72382025-05-22T21:23:33.496ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4cf2bb82-6a0d-47ed-ac54-ba0b4c2bceb8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72392025-05-22T21:23:34.510ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d191ce4a-68cb-4bb1-81c2-8e2c8ec7d1a5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72402025-05-22T21:23:34.510ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d191ce4a-68cb-4bb1-81c2-8e2c8ec7d1a5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72412025-05-22T21:23:34.512ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d191ce4a-68cb-4bb1-81c2-8e2c8ec7d1a5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
72422025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
72432025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72442025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
72452025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72462025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
72472025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
72482025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72492025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72502025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
72512025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
72522025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72532025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72542025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
72552025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 7 reason = Timeout
72562025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72572025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
72582025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
72592025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72602025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
72612025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72622025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
72632025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
72642025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72652025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
72662025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
72672025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
72682025-05-22T21:23:35.084ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72692025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
72702025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72712025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72722025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72732025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
72742025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
72752025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
72762025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72772025-05-22T21:23:35.084ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72782025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
72792025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
72802025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72812025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
72822025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72832025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72842025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
72852025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72862025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
72872025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72882025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
72892025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
72902025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72912025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
72922025-05-22T21:23:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
72932025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72942025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
72952025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
72962025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72972025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
72982025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
72992025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
73002025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
73012025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
73022025-05-22T21:23:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:13:35.085131288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
73032025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
73042025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
73052025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
73062025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
73072025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
73082025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73092025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
73102025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
73112025-05-22T21:23:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
73122025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.97\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
73132025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73142025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73152025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73162025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73172025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73182025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73192025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
73202025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73212025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73222025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73232025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73242025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73252025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73262025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73272025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73282025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73292025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73302025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73312025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
73322025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73332025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73342025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
73352025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
73362025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73372025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73382025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
73392025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
73402025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
73412025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73422025-05-22T21:23:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73432025-05-22T21:23:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 229561442 } })
73442025-05-22T21:23:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 229564693 } })
73452025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73462025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 7 reason = Timeout
73472025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73482025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
73492025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73502025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73512025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
73522025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
73532025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.195848ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
73542025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73552025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
73562025-05-22T21:23:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.626664ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
73572025-05-22T21:23:35.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73582025-05-22T21:23:35.092ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73592025-05-22T21:23:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73602025-05-22T21:23:35.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73612025-05-22T21:23:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73622025-05-22T21:23:35.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73632025-05-22T21:23:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73642025-05-22T21:23:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73652025-05-22T21:23:35.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73662025-05-22T21:23:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73672025-05-22T21:23:35.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73682025-05-22T21:23:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 13.906427ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
73692025-05-22T21:23:35.099ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 242685468 } })
73702025-05-22T21:23:35.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
73712025-05-22T21:23:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73722025-05-22T21:23:35.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73732025-05-22T21:23:35.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73742025-05-22T21:23:35.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73752025-05-22T21:23:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73762025-05-22T21:23:35.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73772025-05-22T21:23:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73782025-05-22T21:23:35.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 258600034 } })
73792025-05-22T21:23:35.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
73802025-05-22T21:23:35.115ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 30.462173ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
73812025-05-22T21:23:35.120ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:13:35.085131288 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
73822025-05-22T21:23:35.120ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 35.682701ms iteration = 7 status = {"expiration":"2025-05-22T21:13:35.085131288Z","pruned":[]}
73832025-05-22T21:23:35.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73842025-05-22T21:23:35.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73852025-05-22T21:23:35.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73862025-05-22T21:23:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73872025-05-22T21:23:35.164ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73882025-05-22T21:23:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73892025-05-22T21:23:35.167ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73902025-05-22T21:23:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73912025-05-22T21:23:35.167ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73922025-05-22T21:23:35.168ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
73932025-05-22T21:23:35.168ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
73942025-05-22T21:23:35.168ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 83.127378ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
73952025-05-22T21:23:35.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73962025-05-22T21:23:35.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73972025-05-22T21:23:35.170ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73982025-05-22T21:23:35.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73992025-05-22T21:23:35.172ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74002025-05-22T21:23:35.173ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74012025-05-22T21:23:35.173ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
74022025-05-22T21:23:35.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74032025-05-22T21:23:35.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
74042025-05-22T21:23:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74052025-05-22T21:23:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
74062025-05-22T21:23:35.174ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.039525ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
74072025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74082025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74092025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
74102025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74112025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
74122025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74132025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74142025-05-22T21:23:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
74152025-05-22T21:23:35.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74162025-05-22T21:23:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74172025-05-22T21:23:35.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74182025-05-22T21:23:35.180ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 95.097236ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
74192025-05-22T21:23:35.182ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74202025-05-22T21:23:35.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74212025-05-22T21:23:35.185ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74222025-05-22T21:23:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74232025-05-22T21:23:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
74242025-05-22T21:23:35.186ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74252025-05-22T21:23:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74262025-05-22T21:23:35.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1324, tv_nsec: 330493575 } })
74272025-05-22T21:23:35.187ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
74282025-05-22T21:23:35.188ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74292025-05-22T21:23:35.189ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
74302025-05-22T21:23:35.189ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 103.115825ms iteration = 7 status = {"by_rx":{},"error":null}
74312025-05-22T21:23:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74322025-05-22T21:23:35.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74332025-05-22T21:23:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74342025-05-22T21:23:35.190ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 105.576771ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
74352025-05-22T21:23:35.191ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74362025-05-22T21:23:35.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74372025-05-22T21:23:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
74382025-05-22T21:23:35.191ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74392025-05-22T21:23:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74402025-05-22T21:23:35.192ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412025-05-22T21:23:35.192ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74422025-05-22T21:23:35.195ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74432025-05-22T21:23:35.195ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74442025-05-22T21:23:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74452025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
74462025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
74472025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74482025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74492025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
74502025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74512025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74522025-05-22T21:23:35.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74532025-05-22T21:23:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74542025-05-22T21:23:35.200ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74552025-05-22T21:23:35.200ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74562025-05-22T21:23:35.200ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74572025-05-22T21:23:35.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74582025-05-22T21:23:35.200ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 116.039756ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74592025-05-22T21:23:35.201ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74602025-05-22T21:23:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74612025-05-22T21:23:35.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74622025-05-22T21:23:35.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74632025-05-22T21:23:35.202ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74642025-05-22T21:23:35.202ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
74652025-05-22T21:23:35.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
74662025-05-22T21:23:35.204ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74672025-05-22T21:23:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74682025-05-22T21:23:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74692025-05-22T21:23:35.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74702025-05-22T21:23:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74712025-05-22T21:23:35.208ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 124.064126ms iteration = 7 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
74722025-05-22T21:23:35.209ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74732025-05-22T21:23:35.210ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74742025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
74752025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74762025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
74772025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74782025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74792025-05-22T21:23:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74802025-05-22T21:23:35.241ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
74812025-05-22T21:23:35.241ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74822025-05-22T21:23:35.241ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "696cc821-b74e-4da5-9012-55b66d20e104", "content-length": "26", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
74832025-05-22T21:23:35.241ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74842025-05-22T21:23:35.242ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74852025-05-22T21:23:35.244ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74862025-05-22T21:23:35.245ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74872025-05-22T21:23:35.245ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
74882025-05-22T21:23:35.245ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
74892025-05-22T21:23:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
74902025-05-22T21:23:35.248ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
74912025-05-22T21:23:35.248ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
74922025-05-22T21:23:35.248ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
74932025-05-22T21:23:35.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74942025-05-22T21:23:35.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74952025-05-22T21:23:35.249ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
74962025-05-22T21:23:35.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74972025-05-22T21:23:35.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 166.786672ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74982025-05-22T21:23:35.252ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 167.856767ms iteration = 4 status = {"nsuccess":5}
74992025-05-22T21:23:35.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 175.993769ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75002025-05-22T21:23:35.262ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75012025-05-22T21:23:35.262ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 177.423469ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75022025-05-22T21:23:35.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75032025-05-22T21:23:35.262ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
75042025-05-22T21:23:35.262ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 177.697824ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
75052025-05-22T21:23:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75062025-05-22T21:23:35.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75072025-05-22T21:23:35.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75082025-05-22T21:23:35.267ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75092025-05-22T21:23:35.269ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75102025-05-22T21:23:35.271ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
75112025-05-22T21:23:35.271ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75122025-05-22T21:23:35.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75132025-05-22T21:23:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
75142025-05-22T21:23:35.272ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
75152025-05-22T21:23:35.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
75162025-05-22T21:23:35.273ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
75172025-05-22T21:23:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
75182025-05-22T21:23:35.274ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 189.353237ms iteration = 13 status = 0
75192025-05-22T21:23:35.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75202025-05-22T21:23:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75212025-05-22T21:23:35.281ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75222025-05-22T21:23:35.281ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
75232025-05-22T21:23:35.281ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.548824ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
75242025-05-22T21:23:35.282ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75252025-05-22T21:23:35.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
75262025-05-22T21:23:35.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75272025-05-22T21:23:35.282ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75282025-05-22T21:23:35.282ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
75292025-05-22T21:23:35.282ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 197.809093ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75302025-05-22T21:23:35.283ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ff6498-307b-4620-b6b4-ae6c2b4dc6b6", "content-length": "26", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
75312025-05-22T21:23:35.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75322025-05-22T21:23:35.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75332025-05-22T21:23:35.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
75342025-05-22T21:23:35.285ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75352025-05-22T21:23:35.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75362025-05-22T21:23:35.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
75372025-05-22T21:23:35.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
75382025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75392025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
75402025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
75412025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
75422025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75432025-05-22T21:23:35.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75442025-05-22T21:23:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75452025-05-22T21:23:35.305ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75462025-05-22T21:23:35.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75472025-05-22T21:23:35.312ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75482025-05-22T21:23:35.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75492025-05-22T21:23:35.320ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 235.162909ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
75502025-05-22T21:23:35.331ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
75512025-05-22T21:23:35.331ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 246.68102ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
75522025-05-22T21:23:35.343ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
75532025-05-22T21:23:35.343ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 258.644428ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
75542025-05-22T21:23:35.371ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75552025-05-22T21:23:35.372ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "e26a0093-aa13-44fc-b915-5defffcaf547", "date": "Thu, 22 May 2025 21:23:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75562025-05-22T21:23:35.372ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75572025-05-22T21:23:35.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "888b0d56-a974-4dec-8ba9-f79082069fba", "date": "Thu, 22 May 2025 21:23:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75582025-05-22T21:23:35.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75592025-05-22T21:23:35.375ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 290.940729ms iteration = 15 status = {"physical_disks_added":0}
75602025-05-22T21:23:35.375ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75612025-05-22T21:23:35.375ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 291.070911ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75622025-05-22T21:23:35.408ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
75632025-05-22T21:23:35.426ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75642025-05-22T21:23:35.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75652025-05-22T21:23:35.450ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75662025-05-22T21:23:35.450ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75672025-05-22T21:23:35.450ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "587f433c-fb9b-4393-a329-7e4f65e888ac", "content-length": "372", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
75682025-05-22T21:23:35.450ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75692025-05-22T21:23:35.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75702025-05-22T21:23:35.452ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75712025-05-22T21:23:35.453ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 369.225224ms iteration = 13 status = null
75722025-05-22T21:23:35.455ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75732025-05-22T21:23:35.455ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75742025-05-22T21:23:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75752025-05-22T21:23:35.469ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
75762025-05-22T21:23:35.469ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75772025-05-22T21:23:35.469ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6ab77be-5a3d-4445-be15-f2e4d7c8a9cf", "content-length": "26", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
75782025-05-22T21:23:35.469ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75792025-05-22T21:23:35.471ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
75802025-05-22T21:23:35.492ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 407.295471ms iteration = 13 status = {}
75812025-05-22T21:23:35.497ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75822025-05-22T21:23:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75832025-05-22T21:23:35.498ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
75842025-05-22T21:23:35.498ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75852025-05-22T21:23:35.498ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75862025-05-22T21:23:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75872025-05-22T21:23:35.499ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75882025-05-22T21:23:35.500ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
75892025-05-22T21:23:35.500ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
75902025-05-22T21:23:35.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75912025-05-22T21:23:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75922025-05-22T21:23:35.500ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75932025-05-22T21:23:35.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75942025-05-22T21:23:35.503ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75952025-05-22T21:23:35.503ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75962025-05-22T21:23:35.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75972025-05-22T21:23:35.505ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75982025-05-22T21:23:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75992025-05-22T21:23:35.505ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
76002025-05-22T21:23:35.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
76012025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76022025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76032025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76042025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76052025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76062025-05-22T21:23:35.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76072025-05-22T21:23:35.508ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
76082025-05-22T21:23:35.508ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
76092025-05-22T21:23:35.508ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
76102025-05-22T21:23:35.508ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 423.952428ms iteration = 7 status = {"generation":1}
76112025-05-22T21:23:35.510ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
76122025-05-22T21:23:35.510ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
76132025-05-22T21:23:35.510ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
76142025-05-22T21:23:35.510ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 425.246628ms iteration = 7 status = {"generation":2}
76152025-05-22T21:23:35.513ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76162025-05-22T21:23:35.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "d499b7e3-7746-4da5-b894-991a11a61c34", "date": "Thu, 22 May 2025 21:23:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76172025-05-22T21:23:35.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76182025-05-22T21:23:35.517ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "53facc2c-1f1b-4122-a4ad-557af82ac9bc", "date": "Thu, 22 May 2025 21:23:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76192025-05-22T21:23:35.517ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76202025-05-22T21:23:35.519ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9da56062-555b-45c2-9313-5207cba70109", "date": "Thu, 22 May 2025 21:23:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76212025-05-22T21:23:35.519ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76222025-05-22T21:23:35.522ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
76232025-05-22T21:23:35.522ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 437.709384ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
76242025-05-22T21:23:35.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc38acd6-9da2-4447-9664-fa8cc8d94d33 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76252025-05-22T21:23:35.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc38acd6-9da2-4447-9664-fa8cc8d94d33 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76262025-05-22T21:23:35.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dc38acd6-9da2-4447-9664-fa8cc8d94d33 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76272025-05-22T21:23:35.530ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
76282025-05-22T21:23:35.530ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76292025-05-22T21:23:35.530ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "fe0c00f5-79f2-4239-985c-5d0bf0257118", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76302025-05-22T21:23:35.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76312025-05-22T21:23:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76322025-05-22T21:23:35.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76332025-05-22T21:23:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76342025-05-22T21:23:35.539ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76352025-05-22T21:23:35.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76362025-05-22T21:23:35.544ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76372025-05-22T21:23:35.544ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76382025-05-22T21:23:35.544ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dc9e80f6-07bc-4347-a52d-38ce2297fd11", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76392025-05-22T21:23:35.546ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 461.993755ms iteration = 13 status = {}
76402025-05-22T21:23:35.598ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
76412025-05-22T21:23:35.598ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 513.918497ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
76422025-05-22T21:23:35.627ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76432025-05-22T21:23:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76442025-05-22T21:23:35.637ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
76452025-05-22T21:23:35.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76462025-05-22T21:23:35.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76472025-05-22T21:23:35.654ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76482025-05-22T21:23:35.654ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
76492025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76502025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76512025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76522025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76532025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76542025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76552025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76562025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76572025-05-22T21:23:35.655ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
76582025-05-22T21:23:35.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76592025-05-22T21:23:35.656ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76602025-05-22T21:23:35.659ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
76612025-05-22T21:23:35.659ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76622025-05-22T21:23:35.693ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76632025-05-22T21:23:35.789ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0727b395-c6ff-49bb-860d-81531d94f398", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76642025-05-22T21:23:35.789ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
76652025-05-22T21:23:35.789ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76662025-05-22T21:23:35.789ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "236db48c-b33a-4bd6-9953-1079faa5b93f", "content-length": "682", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76672025-05-22T21:23:35.789ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76682025-05-22T21:23:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76692025-05-22T21:23:35.792ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76702025-05-22T21:23:35.793ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76712025-05-22T21:23:35.793ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e871bb4d-62da-408e-bcf1-15530264cf5a", "content-length": "691", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76722025-05-22T21:23:35.793ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76732025-05-22T21:23:35.793ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76742025-05-22T21:23:35.793ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76752025-05-22T21:23:35.795ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 710.422572ms iteration = 13 status = {}
76762025-05-22T21:23:35.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76772025-05-22T21:23:35.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76782025-05-22T21:23:35.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76792025-05-22T21:23:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76802025-05-22T21:23:35.809ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 724.42561ms iteration = 13 status = {}
76812025-05-22T21:23:35.823ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 2
76822025-05-22T21:23:35.823ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
76832025-05-22T21:23:35.853ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
76842025-05-22T21:23:35.853ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:39464
76852025-05-22T21:23:35.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39464 req_id = 9f8ed17e-1174-493a-8bd1-3674eb2e2cdb roles = RoleSet { roles: {} } uri = /metrics/producers
76862025-05-22T21:23:35.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39464 req_id = 9f8ed17e-1174-493a-8bd1-3674eb2e2cdb resource = Database result = Ok(()) uri = /metrics/producers
76872025-05-22T21:23:35.911ZINFOnexus: assigned collector to new producer collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 file = nexus/src/app/oximeter.rs:76 producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
76882025-05-22T21:23:35.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 57528 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39464 req_id = 9f8ed17e-1174-493a-8bd1-3674eb2e2cdb response_code = 201 uri = /metrics/producers
76892025-05-22T21:23:35.911ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "9f8ed17e-1174-493a-8bd1-3674eb2e2cdb", "content-length": "41", "date": "Thu, 22 May 2025 21:23:35 GMT"} })
76902025-05-22T21:23:35.912ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
76912025-05-22T21:23:36.549ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69032bba-f768-405c-a302-8eb012401ab4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76922025-05-22T21:23:36.549ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69032bba-f768-405c-a302-8eb012401ab4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76932025-05-22T21:23:36.551ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69032bba-f768-405c-a302-8eb012401ab4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76942025-05-22T21:23:37.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1b3f207-1a7d-4eeb-8ab0-e0cc799f53e8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76952025-05-22T21:23:37.565ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1b3f207-1a7d-4eeb-8ab0-e0cc799f53e8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76962025-05-22T21:23:37.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1b3f207-1a7d-4eeb-8ab0-e0cc799f53e8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76972025-05-22T21:23:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 636 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 1673265c-33d9-4ce9-bec4-cdc573c1a9a9 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
76982025-05-22T21:23:38.580ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41ae0352-8732-456e-9a57-e639751e1d6e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
76992025-05-22T21:23:38.580ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41ae0352-8732-456e-9a57-e639751e1d6e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77002025-05-22T21:23:38.582ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 41ae0352-8732-456e-9a57-e639751e1d6e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77012025-05-22T21:23:39.596ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2982b137-d273-4838-baf1-500ea4e42dfe roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77022025-05-22T21:23:39.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2982b137-d273-4838-baf1-500ea4e42dfe resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77032025-05-22T21:23:39.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2136 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2982b137-d273-4838-baf1-500ea4e42dfe response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77042025-05-22T21:23:40.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bc8f3cd-6d52-458f-b4dd-55d99a411e19 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77052025-05-22T21:23:40.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bc8f3cd-6d52-458f-b4dd-55d99a411e19 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77062025-05-22T21:23:40.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1716 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7bc8f3cd-6d52-458f-b4dd-55d99a411e19 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77072025-05-22T21:23:41.625ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c4ad9a90-386e-4e9e-a9d2-721fd6dcf4b4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77082025-05-22T21:23:41.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c4ad9a90-386e-4e9e-a9d2-721fd6dcf4b4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77092025-05-22T21:23:41.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c4ad9a90-386e-4e9e-a9d2-721fd6dcf4b4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77102025-05-22T21:23:42.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ff0ae972-8c08-4529-a9b8-63ec1d2a06ed roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77112025-05-22T21:23:42.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ff0ae972-8c08-4529-a9b8-63ec1d2a06ed resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77122025-05-22T21:23:42.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ff0ae972-8c08-4529-a9b8-63ec1d2a06ed response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77132025-05-22T21:23:43.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a253bb7b-9db9-4b7f-a308-d7516459fd97 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77142025-05-22T21:23:43.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a253bb7b-9db9-4b7f-a308-d7516459fd97 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77152025-05-22T21:23:43.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a253bb7b-9db9-4b7f-a308-d7516459fd97 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77162025-05-22T21:23:44.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3864b8e7-305f-4edd-aec7-5c313b3d4599 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77172025-05-22T21:23:44.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3864b8e7-305f-4edd-aec7-5c313b3d4599 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77182025-05-22T21:23:44.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3864b8e7-305f-4edd-aec7-5c313b3d4599 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77192025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
77202025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
77212025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77222025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77232025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77242025-05-22T21:23:45.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77252025-05-22T21:23:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77262025-05-22T21:23:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77272025-05-22T21:23:45.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77282025-05-22T21:23:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77292025-05-22T21:23:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77302025-05-22T21:23:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77312025-05-22T21:23:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77322025-05-22T21:23:45.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
77332025-05-22T21:23:45.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77342025-05-22T21:23:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77352025-05-22T21:23:45.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
77362025-05-22T21:23:45.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.709573ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
77372025-05-22T21:23:45.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77382025-05-22T21:23:45.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77392025-05-22T21:23:45.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.89212ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77402025-05-22T21:23:45.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b6e779b-e542-4aa5-9e29-0028fa9ef6db roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77412025-05-22T21:23:45.690ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b6e779b-e542-4aa5-9e29-0028fa9ef6db resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77422025-05-22T21:23:45.692ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2453 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4b6e779b-e542-4aa5-9e29-0028fa9ef6db response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77432025-05-22T21:23:46.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcf114f3-fb4d-4baa-a0ce-0e26db145b80 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77442025-05-22T21:23:46.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcf114f3-fb4d-4baa-a0ce-0e26db145b80 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77452025-05-22T21:23:46.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fcf114f3-fb4d-4baa-a0ce-0e26db145b80 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77462025-05-22T21:23:47.719ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4d967c1-5c68-4823-8df3-a0a39e36a5da roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77472025-05-22T21:23:47.720ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4d967c1-5c68-4823-8df3-a0a39e36a5da resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77482025-05-22T21:23:47.721ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b4d967c1-5c68-4823-8df3-a0a39e36a5da response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77492025-05-22T21:23:48.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d5b1e8ed-70c5-4ac4-8e31-4ed39be72142 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
77502025-05-22T21:23:48.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d5b1e8ed-70c5-4ac4-8e31-4ed39be72142 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
77512025-05-22T21:23:48.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = d5b1e8ed-70c5-4ac4-8e31-4ed39be72142 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
77522025-05-22T21:23:48.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 66d009d1-983d-487e-889c-84c54d201dd6 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
77532025-05-22T21:23:48.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 66d009d1-983d-487e-889c-84c54d201dd6 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
77542025-05-22T21:23:48.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2430 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 66d009d1-983d-487e-889c-84c54d201dd6 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
77552025-05-22T21:23:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 452 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 0025d801-ac2e-4678-af6d-fc7c0373c756 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
77562025-05-22T21:23:48.734ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08d71a53-a5c4-444d-9338-088c17bc4ff2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77572025-05-22T21:23:48.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08d71a53-a5c4-444d-9338-088c17bc4ff2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77582025-05-22T21:23:48.736ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08d71a53-a5c4-444d-9338-088c17bc4ff2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77592025-05-22T21:23:49.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8bac9c8-5ef9-4df3-a523-69546840546f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77602025-05-22T21:23:49.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8bac9c8-5ef9-4df3-a523-69546840546f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77612025-05-22T21:23:49.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8bac9c8-5ef9-4df3-a523-69546840546f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77622025-05-22T21:23:50.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1a0cda9f-2cda-422d-bb5c-9db70b2b0179 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77632025-05-22T21:23:50.768ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1a0cda9f-2cda-422d-bb5c-9db70b2b0179 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77642025-05-22T21:23:50.770ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1a0cda9f-2cda-422d-bb5c-9db70b2b0179 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77652025-05-22T21:23:51.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b44473a7-13b9-4eb2-bbe3-97f878a44946 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77662025-05-22T21:23:51.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b44473a7-13b9-4eb2-bbe3-97f878a44946 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77672025-05-22T21:23:51.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b44473a7-13b9-4eb2-bbe3-97f878a44946 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77682025-05-22T21:23:52.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570694-9c07-4154-b835-384439e12030 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77692025-05-22T21:23:52.800ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570694-9c07-4154-b835-384439e12030 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77702025-05-22T21:23:52.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f570694-9c07-4154-b835-384439e12030 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77712025-05-22T21:23:53.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04fd77ee-9b91-4668-8da2-13aa49e7d7e7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77722025-05-22T21:23:53.815ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04fd77ee-9b91-4668-8da2-13aa49e7d7e7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77732025-05-22T21:23:53.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1939 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04fd77ee-9b91-4668-8da2-13aa49e7d7e7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77742025-05-22T21:23:54.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33dcd7ac-5383-4b1b-99c8-bf371c342599 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77752025-05-22T21:23:54.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33dcd7ac-5383-4b1b-99c8-bf371c342599 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77762025-05-22T21:23:54.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2679 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33dcd7ac-5383-4b1b-99c8-bf371c342599 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77772025-05-22T21:23:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
77782025-05-22T21:23:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
77792025-05-22T21:23:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77802025-05-22T21:23:55.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77812025-05-22T21:23:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77822025-05-22T21:23:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77832025-05-22T21:23:55.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77842025-05-22T21:23:55.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77852025-05-22T21:23:55.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77862025-05-22T21:23:55.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.548848ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77872025-05-22T21:23:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77882025-05-22T21:23:55.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77892025-05-22T21:23:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77902025-05-22T21:23:55.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77912025-05-22T21:23:55.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77922025-05-22T21:23:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77932025-05-22T21:23:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
77942025-05-22T21:23:55.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77952025-05-22T21:23:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77962025-05-22T21:23:55.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
77972025-05-22T21:23:55.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.268247ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
77982025-05-22T21:23:55.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 106f8464-d5dc-4bea-afb7-23283af655fe roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
77992025-05-22T21:23:55.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 106f8464-d5dc-4bea-afb7-23283af655fe resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78002025-05-22T21:23:55.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2234 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 106f8464-d5dc-4bea-afb7-23283af655fe response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78012025-05-22T21:23:56.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0eb6d39e-2572-4438-b3ff-cbf845173b53 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78022025-05-22T21:23:56.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0eb6d39e-2572-4438-b3ff-cbf845173b53 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78032025-05-22T21:23:56.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0eb6d39e-2572-4438-b3ff-cbf845173b53 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78042025-05-22T21:23:57.880ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978f1d4b-413a-4e38-a5a7-20d550d6916c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78052025-05-22T21:23:57.881ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978f1d4b-413a-4e38-a5a7-20d550d6916c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78062025-05-22T21:23:57.883ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 978f1d4b-413a-4e38-a5a7-20d550d6916c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78072025-05-22T21:23:58.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 837 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 58b7c35d-a3e4-4c6c-b354-24a01a727f97 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
78082025-05-22T21:23:58.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e5c529b-3271-4d78-9d7c-47558d80621e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78092025-05-22T21:23:58.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e5c529b-3271-4d78-9d7c-47558d80621e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78102025-05-22T21:23:58.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e5c529b-3271-4d78-9d7c-47558d80621e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78112025-05-22T21:23:59.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a96732b0-5d13-45ef-8916-ce3feee6e79a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78122025-05-22T21:23:59.912ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a96732b0-5d13-45ef-8916-ce3feee6e79a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78132025-05-22T21:23:59.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2208 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a96732b0-5d13-45ef-8916-ce3feee6e79a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78142025-05-22T21:24:00.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 685b9fe9-31df-466d-b090-9d8d4356b89e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78152025-05-22T21:24:00.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 685b9fe9-31df-466d-b090-9d8d4356b89e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78162025-05-22T21:24:00.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 685b9fe9-31df-466d-b090-9d8d4356b89e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78172025-05-22T21:24:01.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76df4742-a8d0-4b2e-af4c-622f817c9dc6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78182025-05-22T21:24:01.946ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76df4742-a8d0-4b2e-af4c-622f817c9dc6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78192025-05-22T21:24:01.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76df4742-a8d0-4b2e-af4c-622f817c9dc6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78202025-05-22T21:24:02.962ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190faa59-5041-4ef8-a2a4-3330ec6a8a8c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78212025-05-22T21:24:02.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190faa59-5041-4ef8-a2a4-3330ec6a8a8c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78222025-05-22T21:24:02.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2394 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 190faa59-5041-4ef8-a2a4-3330ec6a8a8c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78232025-05-22T21:24:03.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 96f47dc1-902f-4b26-a27e-70a5187d1e66 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78242025-05-22T21:24:03.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 96f47dc1-902f-4b26-a27e-70a5187d1e66 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78252025-05-22T21:24:03.980ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 96f47dc1-902f-4b26-a27e-70a5187d1e66 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78262025-05-22T21:24:04.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3a43148-0f5c-417a-9492-3a821ccf93fa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78272025-05-22T21:24:04.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3a43148-0f5c-417a-9492-3a821ccf93fa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78282025-05-22T21:24:04.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f3a43148-0f5c-417a-9492-3a821ccf93fa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
78292025-05-22T21:24:05.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
78302025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
78312025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
78322025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78332025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
78342025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78352025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
78362025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
78372025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78382025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
78392025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
78402025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78412025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78422025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
78432025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78442025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
78452025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
78462025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78472025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
78482025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
78492025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
78502025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78512025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
78522025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
78532025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
78542025-05-22T21:24:05.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
78552025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78562025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
78572025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
78582025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78592025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78602025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
78612025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78622025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
78632025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78642025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
78652025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78662025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
78672025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78682025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78692025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78702025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78712025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78722025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78732025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78742025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78752025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
78762025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78772025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78782025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78792025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78802025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78812025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78822025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78832025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
78842025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78852025-05-22T21:24:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78862025-05-22T21:24:05.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78872025-05-22T21:24:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.991474ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
78882025-05-22T21:24:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.242889ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78892025-05-22T21:24:05.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78902025-05-22T21:24:05.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78912025-05-22T21:24:05.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78922025-05-22T21:24:05.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78932025-05-22T21:24:05.091ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78942025-05-22T21:24:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78952025-05-22T21:24:05.092ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78962025-05-22T21:24:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78972025-05-22T21:24:05.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78982025-05-22T21:24:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78992025-05-22T21:24:05.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79002025-05-22T21:24:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79012025-05-22T21:24:05.095ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 10.570007ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
79022025-05-22T21:24:05.096ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79032025-05-22T21:24:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79042025-05-22T21:24:05.096ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79052025-05-22T21:24:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79062025-05-22T21:24:05.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072025-05-22T21:24:05.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79082025-05-22T21:24:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
79092025-05-22T21:24:05.098ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79102025-05-22T21:24:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79112025-05-22T21:24:05.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79122025-05-22T21:24:05.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79132025-05-22T21:24:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79142025-05-22T21:24:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79152025-05-22T21:24:05.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79162025-05-22T21:24:05.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79172025-05-22T21:24:05.102ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 245615290 } })
79182025-05-22T21:24:05.102ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
79192025-05-22T21:24:05.103ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 246859808 } })
79202025-05-22T21:24:05.103ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
79212025-05-22T21:24:05.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79222025-05-22T21:24:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79232025-05-22T21:24:05.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79242025-05-22T21:24:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79252025-05-22T21:24:05.106ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1354, tv_nsec: 249645670 } })
79262025-05-22T21:24:05.106ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
79272025-05-22T21:24:05.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79282025-05-22T21:24:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79292025-05-22T21:24:05.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79302025-05-22T21:24:05.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79312025-05-22T21:24:05.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79322025-05-22T21:24:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79332025-05-22T21:24:05.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79342025-05-22T21:24:05.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79352025-05-22T21:24:05.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79362025-05-22T21:24:05.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
79372025-05-22T21:24:05.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79382025-05-22T21:24:05.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79392025-05-22T21:24:05.118ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79402025-05-22T21:24:05.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79412025-05-22T21:24:05.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79422025-05-22T21:24:05.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79432025-05-22T21:24:05.131ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
79442025-05-22T21:24:05.131ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 46.827747ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
79452025-05-22T21:24:05.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
79462025-05-22T21:24:05.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
79472025-05-22T21:24:05.146ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79482025-05-22T21:24:05.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79492025-05-22T21:24:05.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79502025-05-22T21:24:05.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79512025-05-22T21:24:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.621431ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
79522025-05-22T21:24:05.157ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
79532025-05-22T21:24:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
79542025-05-22T21:24:05.158ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79552025-05-22T21:24:05.158ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79562025-05-22T21:24:05.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79572025-05-22T21:24:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79582025-05-22T21:24:05.165ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
79592025-05-22T21:24:05.165ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.797222ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
79602025-05-22T21:24:05.172ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
79612025-05-22T21:24:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
79622025-05-22T21:24:05.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79632025-05-22T21:24:05.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79642025-05-22T21:24:05.221ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
79652025-05-22T21:24:05.221ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79662025-05-22T21:24:05.221ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c91becd-1e95-49cf-8f55-a90d49a2f6cc", "content-length": "26", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
79672025-05-22T21:24:05.221ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79682025-05-22T21:24:05.223ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79692025-05-22T21:24:05.228ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
79702025-05-22T21:24:05.228ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79712025-05-22T21:24:05.229ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "33f83560-c64b-4bf8-b8ae-7731a789fda0", "content-length": "26", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
79722025-05-22T21:24:05.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79732025-05-22T21:24:05.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79742025-05-22T21:24:05.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79752025-05-22T21:24:05.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79762025-05-22T21:24:05.239ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
79772025-05-22T21:24:05.239ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79782025-05-22T21:24:05.240ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06557a74-3d7a-47cb-b3ed-8269bc7bf85d", "content-length": "26", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
79792025-05-22T21:24:05.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79802025-05-22T21:24:05.241ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
79812025-05-22T21:24:05.248ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 163.490623ms iteration = 16 status = {"physical_disks_added":0}
79822025-05-22T21:24:05.251ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79832025-05-22T21:24:05.251ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79842025-05-22T21:24:05.251ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec457e1f-c7f4-4c60-94c0-7e2ad9e6a4ac", "content-length": "372", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
79852025-05-22T21:24:05.251ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79862025-05-22T21:24:05.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79872025-05-22T21:24:05.254ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79882025-05-22T21:24:05.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79892025-05-22T21:24:05.255ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79902025-05-22T21:24:05.256ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79912025-05-22T21:24:05.258ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79922025-05-22T21:24:05.258ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79932025-05-22T21:24:05.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79942025-05-22T21:24:05.265ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
79952025-05-22T21:24:05.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79962025-05-22T21:24:05.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79972025-05-22T21:24:05.268ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 183.234026ms iteration = 14 status = 0
79982025-05-22T21:24:05.294ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79992025-05-22T21:24:05.294ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80002025-05-22T21:24:05.294ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80012025-05-22T21:24:05.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80022025-05-22T21:24:05.295ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032025-05-22T21:24:05.297ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
80042025-05-22T21:24:05.297ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
80052025-05-22T21:24:05.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
80062025-05-22T21:24:05.307ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 222.551841ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80072025-05-22T21:24:05.309ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
80082025-05-22T21:24:05.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
80092025-05-22T21:24:05.312ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 227.007478ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80102025-05-22T21:24:05.313ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 228.819424ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80112025-05-22T21:24:05.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122025-05-22T21:24:05.319ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80132025-05-22T21:24:05.319ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80142025-05-22T21:24:05.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80152025-05-22T21:24:05.322ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
80162025-05-22T21:24:05.322ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80172025-05-22T21:24:05.322ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c8d0f401-bd3b-426e-a696-af4bac794c57", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
80182025-05-22T21:24:05.322ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80192025-05-22T21:24:05.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80202025-05-22T21:24:05.325ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80212025-05-22T21:24:05.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80222025-05-22T21:24:05.327ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80232025-05-22T21:24:05.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80242025-05-22T21:24:05.330ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80252025-05-22T21:24:05.330ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80262025-05-22T21:24:05.330ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "621ddb2e-4db5-47e0-bf56-41ba816e6669", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
80272025-05-22T21:24:05.331ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
80282025-05-22T21:24:05.331ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 246.545379ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
80292025-05-22T21:24:05.331ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80302025-05-22T21:24:05.331ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80312025-05-22T21:24:05.331ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 246.920753ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80322025-05-22T21:24:05.332ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80332025-05-22T21:24:05.333ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 247.958459ms iteration = 14 status = {}
80342025-05-22T21:24:05.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80352025-05-22T21:24:05.335ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 250.02499ms iteration = 14 status = null
80362025-05-22T21:24:05.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 257.603282ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
80372025-05-22T21:24:05.364ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 279.799413ms iteration = 14 status = {}
80382025-05-22T21:24:05.415ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
80392025-05-22T21:24:05.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80402025-05-22T21:24:05.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80412025-05-22T21:24:05.450ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
80422025-05-22T21:24:05.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80432025-05-22T21:24:05.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80442025-05-22T21:24:05.457ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80452025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
80462025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80472025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80482025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80492025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80502025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80512025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80522025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80532025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80542025-05-22T21:24:05.458ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
80552025-05-22T21:24:05.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80562025-05-22T21:24:05.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80572025-05-22T21:24:05.461ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
80582025-05-22T21:24:05.461ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
80592025-05-22T21:24:05.466ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d39feb87-e8fc-493a-a320-3512f0c24312", "content-length": "691", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
80602025-05-22T21:24:05.466ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
80612025-05-22T21:24:05.466ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
80622025-05-22T21:24:05.466ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
80632025-05-22T21:24:05.467ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 382.615403ms iteration = 14 status = {}
80642025-05-22T21:24:05.563ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e18f0c20-558a-47bb-b82f-469815fa3e6b", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
80652025-05-22T21:24:05.563ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
80662025-05-22T21:24:05.563ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
80672025-05-22T21:24:05.564ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b5b2bec-16fb-4002-88b1-1136e9e5f095", "content-length": "682", "date": "Thu, 22 May 2025 21:24:05 GMT"} })
80682025-05-22T21:24:05.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80692025-05-22T21:24:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80702025-05-22T21:24:05.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80712025-05-22T21:24:05.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80722025-05-22T21:24:05.578ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80732025-05-22T21:24:05.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80742025-05-22T21:24:05.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80752025-05-22T21:24:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80762025-05-22T21:24:05.589ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 504.05075ms iteration = 14 status = {}
80772025-05-22T21:24:06.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94b4e809-296a-4d5b-994d-3f1ea23ada2b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80782025-05-22T21:24:06.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94b4e809-296a-4d5b-994d-3f1ea23ada2b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80792025-05-22T21:24:06.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94b4e809-296a-4d5b-994d-3f1ea23ada2b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80802025-05-22T21:24:07.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d28eeef-efa8-4ff3-b0ff-b4bc3891a76c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80812025-05-22T21:24:07.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d28eeef-efa8-4ff3-b0ff-b4bc3891a76c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80822025-05-22T21:24:07.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d28eeef-efa8-4ff3-b0ff-b4bc3891a76c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80832025-05-22T21:24:08.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 783ac03f-ee02-4fa3-a3b3-e0a9eaa9832a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80842025-05-22T21:24:08.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 783ac03f-ee02-4fa3-a3b3-e0a9eaa9832a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80852025-05-22T21:24:08.043ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 783ac03f-ee02-4fa3-a3b3-e0a9eaa9832a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80862025-05-22T21:24:08.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 444 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 8485fb9b-4c7d-4093-a80c-22ac1bc5f17e response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
80872025-05-22T21:24:09.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd24a63e-5c18-4717-9387-602e25e504ac roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80882025-05-22T21:24:09.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd24a63e-5c18-4717-9387-602e25e504ac resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80892025-05-22T21:24:09.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2483 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd24a63e-5c18-4717-9387-602e25e504ac response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80902025-05-22T21:24:10.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ecd0b5f0-71b6-4f8b-9293-9e912b55cdb6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80912025-05-22T21:24:10.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ecd0b5f0-71b6-4f8b-9293-9e912b55cdb6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80922025-05-22T21:24:10.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2346 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ecd0b5f0-71b6-4f8b-9293-9e912b55cdb6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80932025-05-22T21:24:11.087ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f554acfc-2702-44d8-aad0-5d570f0cf8f4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80942025-05-22T21:24:11.087ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f554acfc-2702-44d8-aad0-5d570f0cf8f4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80952025-05-22T21:24:11.089ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f554acfc-2702-44d8-aad0-5d570f0cf8f4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80962025-05-22T21:24:12.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06551f70-88d7-411a-916d-b069e2031bb9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80972025-05-22T21:24:12.102ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06551f70-88d7-411a-916d-b069e2031bb9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80982025-05-22T21:24:12.104ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06551f70-88d7-411a-916d-b069e2031bb9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
80992025-05-22T21:24:13.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b49826f7-1ae0-482b-9d42-45c876574229 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81002025-05-22T21:24:13.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b49826f7-1ae0-482b-9d42-45c876574229 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81012025-05-22T21:24:13.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2334 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b49826f7-1ae0-482b-9d42-45c876574229 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81022025-05-22T21:24:14.134ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 497b0f7c-70e4-472f-a382-bafe5a7e84cb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81032025-05-22T21:24:14.134ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 497b0f7c-70e4-472f-a382-bafe5a7e84cb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81042025-05-22T21:24:14.136ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2237 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 497b0f7c-70e4-472f-a382-bafe5a7e84cb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81052025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
81062025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81072025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
81082025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81092025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81102025-05-22T21:24:15.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81112025-05-22T21:24:15.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81122025-05-22T21:24:15.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81132025-05-22T21:24:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81142025-05-22T21:24:15.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.249328ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81152025-05-22T21:24:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81162025-05-22T21:24:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81172025-05-22T21:24:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81182025-05-22T21:24:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81192025-05-22T21:24:15.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81202025-05-22T21:24:15.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81212025-05-22T21:24:15.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
81222025-05-22T21:24:15.127ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81232025-05-22T21:24:15.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81242025-05-22T21:24:15.135ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
81252025-05-22T21:24:15.135ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.520307ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
81262025-05-22T21:24:15.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 191139be-06ab-473a-9ab6-c379863b88bd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81272025-05-22T21:24:15.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 191139be-06ab-473a-9ab6-c379863b88bd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81282025-05-22T21:24:15.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 191139be-06ab-473a-9ab6-c379863b88bd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81292025-05-22T21:24:16.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b73c54ea-825e-467a-80e4-b0a1dfdfd25d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81302025-05-22T21:24:16.165ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b73c54ea-825e-467a-80e4-b0a1dfdfd25d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81312025-05-22T21:24:16.167ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b73c54ea-825e-467a-80e4-b0a1dfdfd25d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81322025-05-22T21:24:17.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 380e55c8-2433-4973-b672-8e14cadc8cb6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81332025-05-22T21:24:17.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 380e55c8-2433-4973-b672-8e14cadc8cb6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81342025-05-22T21:24:17.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 380e55c8-2433-4973-b672-8e14cadc8cb6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81352025-05-22T21:24:18.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 0e671dca-9c11-4169-bc3e-11d567def534 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
81362025-05-22T21:24:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 0e671dca-9c11-4169-bc3e-11d567def534 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
81372025-05-22T21:24:18.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 0e671dca-9c11-4169-bc3e-11d567def534 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
81382025-05-22T21:24:18.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = c4a91528-1e70-4360-ad11-c5edbbe8e9b1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
81392025-05-22T21:24:18.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = c4a91528-1e70-4360-ad11-c5edbbe8e9b1 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
81402025-05-22T21:24:18.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = c4a91528-1e70-4360-ad11-c5edbbe8e9b1 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
81412025-05-22T21:24:18.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 524 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 61de5cf8-8c5e-4065-bb86-6713c26182e6 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
81422025-05-22T21:24:18.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8b68bce5-cca0-464a-992c-10c836eebc6e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81432025-05-22T21:24:18.197ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8b68bce5-cca0-464a-992c-10c836eebc6e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81442025-05-22T21:24:18.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8b68bce5-cca0-464a-992c-10c836eebc6e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81452025-05-22T21:24:19.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a00dac8-23eb-49dc-ab36-2754b94c4590 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81462025-05-22T21:24:19.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a00dac8-23eb-49dc-ab36-2754b94c4590 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81472025-05-22T21:24:19.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2414 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a00dac8-23eb-49dc-ab36-2754b94c4590 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81482025-05-22T21:24:20.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028db578-5fa9-4187-8cb3-2f13fbbb1839 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81492025-05-22T21:24:20.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028db578-5fa9-4187-8cb3-2f13fbbb1839 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81502025-05-22T21:24:20.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028db578-5fa9-4187-8cb3-2f13fbbb1839 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81512025-05-22T21:24:21.242ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d857b82b-42b6-4ffb-b8cb-f413a772a4bb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81522025-05-22T21:24:21.243ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d857b82b-42b6-4ffb-b8cb-f413a772a4bb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81532025-05-22T21:24:21.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d857b82b-42b6-4ffb-b8cb-f413a772a4bb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81542025-05-22T21:24:22.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d7661b-539a-4773-bb7f-4ed69ca75a2f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81552025-05-22T21:24:22.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d7661b-539a-4773-bb7f-4ed69ca75a2f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81562025-05-22T21:24:22.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04d7661b-539a-4773-bb7f-4ed69ca75a2f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81572025-05-22T21:24:23.273ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d81e0a9-08d9-4bb9-b671-1f1c9082a03d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81582025-05-22T21:24:23.273ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d81e0a9-08d9-4bb9-b671-1f1c9082a03d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81592025-05-22T21:24:23.275ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d81e0a9-08d9-4bb9-b671-1f1c9082a03d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81602025-05-22T21:24:24.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e5b4cde-b655-4db2-a4d7-a48cb1b191f0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81612025-05-22T21:24:24.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e5b4cde-b655-4db2-a4d7-a48cb1b191f0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81622025-05-22T21:24:24.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e5b4cde-b655-4db2-a4d7-a48cb1b191f0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81632025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
81642025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
81652025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81662025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81672025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81682025-05-22T21:24:25.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81692025-05-22T21:24:25.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81702025-05-22T21:24:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81712025-05-22T21:24:25.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81722025-05-22T21:24:25.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.163598ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81732025-05-22T21:24:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81742025-05-22T21:24:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81752025-05-22T21:24:25.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81762025-05-22T21:24:25.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81772025-05-22T21:24:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81782025-05-22T21:24:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81792025-05-22T21:24:25.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
81802025-05-22T21:24:25.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81812025-05-22T21:24:25.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81822025-05-22T21:24:25.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
81832025-05-22T21:24:25.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.486075ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
81842025-05-22T21:24:25.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4e53596-7280-47c1-b1b2-ee626156d691 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81852025-05-22T21:24:25.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4e53596-7280-47c1-b1b2-ee626156d691 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81862025-05-22T21:24:25.305ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1851 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4e53596-7280-47c1-b1b2-ee626156d691 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81872025-05-22T21:24:26.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe910b56-d916-48f7-80b4-663902c8f4ee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81882025-05-22T21:24:26.318ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe910b56-d916-48f7-80b4-663902c8f4ee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81892025-05-22T21:24:26.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2127 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe910b56-d916-48f7-80b4-663902c8f4ee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81902025-05-22T21:24:27.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 61be1f7c-61ad-42d7-97c1-f7be4ab42de3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81912025-05-22T21:24:27.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 61be1f7c-61ad-42d7-97c1-f7be4ab42de3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81922025-05-22T21:24:27.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2085 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 61be1f7c-61ad-42d7-97c1-f7be4ab42de3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81932025-05-22T21:24:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 528 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 2dd362f2-6e31-4e15-8046-2044625ee264 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
81942025-05-22T21:24:28.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83a3bfd7-689c-4a05-9ff7-1bf6f311c7de roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81952025-05-22T21:24:28.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83a3bfd7-689c-4a05-9ff7-1bf6f311c7de resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81962025-05-22T21:24:28.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2281 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 83a3bfd7-689c-4a05-9ff7-1bf6f311c7de response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81972025-05-22T21:24:29.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df22a5a7-9b7f-4750-ba1b-a51a68e6307f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81982025-05-22T21:24:29.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df22a5a7-9b7f-4750-ba1b-a51a68e6307f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
81992025-05-22T21:24:29.373ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = df22a5a7-9b7f-4750-ba1b-a51a68e6307f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82002025-05-22T21:24:30.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b8152e-1a18-4404-9fd4-eede3ca60802 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82012025-05-22T21:24:30.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b8152e-1a18-4404-9fd4-eede3ca60802 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82022025-05-22T21:24:30.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 29b8152e-1a18-4404-9fd4-eede3ca60802 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82032025-05-22T21:24:31.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4caa8caf-c2dd-470d-83f0-e12fd463d956 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82042025-05-22T21:24:31.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4caa8caf-c2dd-470d-83f0-e12fd463d956 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82052025-05-22T21:24:31.405ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4caa8caf-c2dd-470d-83f0-e12fd463d956 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82062025-05-22T21:24:32.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436c7f20-238e-4a2f-a457-c421e73aea9a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82072025-05-22T21:24:32.419ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436c7f20-238e-4a2f-a457-c421e73aea9a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82082025-05-22T21:24:32.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2459 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436c7f20-238e-4a2f-a457-c421e73aea9a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82092025-05-22T21:24:33.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 976a7802-668e-42c6-be13-3177644c2191 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
82102025-05-22T21:24:33.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 976a7802-668e-42c6-be13-3177644c2191 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
82112025-05-22T21:24:33.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = 976a7802-668e-42c6-be13-3177644c2191 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
82122025-05-22T21:24:33.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = f996377a-734e-4e25-9c3b-5597ff21531a roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
82132025-05-22T21:24:33.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = f996377a-734e-4e25-9c3b-5597ff21531a resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
82142025-05-22T21:24:33.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:46625 req_id = f996377a-734e-4e25-9c3b-5597ff21531a response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
82152025-05-22T21:24:33.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb10df1-9377-426e-b682-a0cc05e423c1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82162025-05-22T21:24:33.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb10df1-9377-426e-b682-a0cc05e423c1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82172025-05-22T21:24:33.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aeb10df1-9377-426e-b682-a0cc05e423c1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82182025-05-22T21:24:34.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ff9ef72-1053-43e0-be1e-db4d275096bc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82192025-05-22T21:24:34.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ff9ef72-1053-43e0-be1e-db4d275096bc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82202025-05-22T21:24:34.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2682 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ff9ef72-1053-43e0-be1e-db4d275096bc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
82212025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
82222025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82232025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
82242025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
82252025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
82262025-05-22T21:24:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
82272025-05-22T21:24:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
82282025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82292025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82302025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
82312025-05-22T21:24:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
82322025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.181\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
82332025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
82342025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
82352025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82362025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82372025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82382025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
82392025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
82402025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
82412025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
82422025-05-22T21:24:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
82432025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
82442025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
82452025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82462025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82472025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
82482025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82492025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
82502025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82512025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
82522025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82532025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
82542025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82552025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
82562025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82572025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
82582025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82592025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 8 reason = Timeout
82602025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
82612025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
82622025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82632025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82642025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
82652025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
82662025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
82672025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82682025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
82692025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82702025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
82712025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
82722025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
82732025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
82742025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
82752025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82762025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
82772025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82782025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
82792025-05-22T21:24:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:14:35.085327493 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
82802025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82812025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
82822025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
82832025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
82842025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82852025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82862025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
82872025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
82882025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82892025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82902025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82912025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82922025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
82932025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82942025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82952025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
82962025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82972025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82982025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
82992025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
83002025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
83012025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83022025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83032025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83042025-05-22T21:24:35.085ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 229221513 } })
83052025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
83062025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83072025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83082025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83092025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
83102025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
83112025-05-22T21:24:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83122025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83132025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
83142025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83152025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
83162025-05-22T21:24:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 229362815 } })
83172025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83182025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 8 reason = Timeout
83192025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
83202025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
83212025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.138557ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
83222025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
83232025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.246408ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
83242025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83252025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
83262025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83272025-05-22T21:24:35.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83282025-05-22T21:24:35.088ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83292025-05-22T21:24:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.495992ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
83302025-05-22T21:24:35.088ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83312025-05-22T21:24:35.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.926193ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
83322025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83332025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83342025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83352025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83362025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
83372025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83382025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83392025-05-22T21:24:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83402025-05-22T21:24:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83412025-05-22T21:24:35.095ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 10.72206ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
83422025-05-22T21:24:35.098ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83432025-05-22T21:24:35.098ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83442025-05-22T21:24:35.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83452025-05-22T21:24:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83462025-05-22T21:24:35.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83472025-05-22T21:24:35.106ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 250147795 } })
83482025-05-22T21:24:35.107ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83492025-05-22T21:24:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83502025-05-22T21:24:35.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
83512025-05-22T21:24:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83522025-05-22T21:24:35.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83532025-05-22T21:24:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83542025-05-22T21:24:35.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552025-05-22T21:24:35.113ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:14:35.085327493 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
83562025-05-22T21:24:35.113ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.559915ms iteration = 8 status = {"expiration":"2025-05-22T21:14:35.085327493Z","pruned":[]}
83572025-05-22T21:24:35.115ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 259056967 } })
83582025-05-22T21:24:35.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
83592025-05-22T21:24:35.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83602025-05-22T21:24:35.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83612025-05-22T21:24:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83622025-05-22T21:24:35.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83632025-05-22T21:24:35.127ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
83642025-05-22T21:24:35.128ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 41.67739ms iteration = 8 status = {"by_rx":{},"error":null}
83652025-05-22T21:24:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
83662025-05-22T21:24:35.130ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83672025-05-22T21:24:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83682025-05-22T21:24:35.141ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83692025-05-22T21:24:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83702025-05-22T21:24:35.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83712025-05-22T21:24:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83722025-05-22T21:24:35.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83732025-05-22T21:24:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83742025-05-22T21:24:35.150ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83752025-05-22T21:24:35.150ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83762025-05-22T21:24:35.150ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83772025-05-22T21:24:35.150ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83782025-05-22T21:24:35.150ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83792025-05-22T21:24:35.150ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.553535ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83802025-05-22T21:24:35.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83812025-05-22T21:24:35.156ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
83822025-05-22T21:24:35.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
83832025-05-22T21:24:35.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83842025-05-22T21:24:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83852025-05-22T21:24:35.158ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83862025-05-22T21:24:35.162ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83872025-05-22T21:24:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
83882025-05-22T21:24:35.164ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83892025-05-22T21:24:35.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83902025-05-22T21:24:35.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83912025-05-22T21:24:35.168ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83922025-05-22T21:24:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83932025-05-22T21:24:35.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83942025-05-22T21:24:35.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83952025-05-22T21:24:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83962025-05-22T21:24:35.172ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83972025-05-22T21:24:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83982025-05-22T21:24:35.173ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83992025-05-22T21:24:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
84002025-05-22T21:24:35.173ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84012025-05-22T21:24:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84022025-05-22T21:24:35.174ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 89.582173ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
84032025-05-22T21:24:35.175ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84042025-05-22T21:24:35.175ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84052025-05-22T21:24:35.175ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 90.894793ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84062025-05-22T21:24:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
84072025-05-22T21:24:35.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84082025-05-22T21:24:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84092025-05-22T21:24:35.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84102025-05-22T21:24:35.179ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 94.543947ms iteration = 8 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
84112025-05-22T21:24:35.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84122025-05-22T21:24:35.181ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84132025-05-22T21:24:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84142025-05-22T21:24:35.183ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84152025-05-22T21:24:35.186ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1384, tv_nsec: 329877421 } })
84162025-05-22T21:24:35.186ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
84172025-05-22T21:24:35.187ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
84182025-05-22T21:24:35.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
84192025-05-22T21:24:35.188ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84202025-05-22T21:24:35.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84212025-05-22T21:24:35.191ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
84222025-05-22T21:24:35.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 106.575846ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
84232025-05-22T21:24:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
84242025-05-22T21:24:35.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
84252025-05-22T21:24:35.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84262025-05-22T21:24:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84272025-05-22T21:24:35.197ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84282025-05-22T21:24:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84292025-05-22T21:24:35.200ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
84302025-05-22T21:24:35.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
84312025-05-22T21:24:35.203ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
84322025-05-22T21:24:35.203ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.415502ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
84332025-05-22T21:24:35.204ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84342025-05-22T21:24:35.204ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
84352025-05-22T21:24:35.204ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 119.988196ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84362025-05-22T21:24:35.206ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84372025-05-22T21:24:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
84382025-05-22T21:24:35.208ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
84392025-05-22T21:24:35.208ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
84402025-05-22T21:24:35.213ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84412025-05-22T21:24:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84422025-05-22T21:24:35.225ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84432025-05-22T21:24:35.225ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84442025-05-22T21:24:35.225ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84452025-05-22T21:24:35.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84462025-05-22T21:24:35.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84472025-05-22T21:24:35.231ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 146.299487ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84482025-05-22T21:24:35.236ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
84492025-05-22T21:24:35.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
84502025-05-22T21:24:35.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 153.905579ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
84512025-05-22T21:24:35.241ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84522025-05-22T21:24:35.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84532025-05-22T21:24:35.243ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84542025-05-22T21:24:35.243ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84552025-05-22T21:24:35.243ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84562025-05-22T21:24:35.243ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84572025-05-22T21:24:35.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84582025-05-22T21:24:35.244ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 159.233469ms iteration = 17 status = {"physical_disks_added":0}
84592025-05-22T21:24:35.266ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
84602025-05-22T21:24:35.266ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84612025-05-22T21:24:35.267ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d89ba58-054c-487d-acf6-bc5acf045c14", "content-length": "26", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
84622025-05-22T21:24:35.267ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84632025-05-22T21:24:35.268ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84642025-05-22T21:24:35.273ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84652025-05-22T21:24:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84662025-05-22T21:24:35.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84672025-05-22T21:24:35.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84682025-05-22T21:24:35.287ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
84692025-05-22T21:24:35.287ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84702025-05-22T21:24:35.287ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bf12196-e8b3-4a50-b387-44c13819ff75", "content-length": "26", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
84712025-05-22T21:24:35.287ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84722025-05-22T21:24:35.288ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84732025-05-22T21:24:35.358ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84742025-05-22T21:24:35.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
84752025-05-22T21:24:35.374ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84762025-05-22T21:24:35.374ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "605c83eb-73e5-4959-bb29-85add0d6bc72", "content-length": "26", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
84772025-05-22T21:24:35.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84782025-05-22T21:24:35.375ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
84792025-05-22T21:24:35.405ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84802025-05-22T21:24:35.407ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84812025-05-22T21:24:35.407ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84822025-05-22T21:24:35.407ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7a28e2f-0a51-4d08-9856-1a4f14f7dd3e", "content-length": "372", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
84832025-05-22T21:24:35.407ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84842025-05-22T21:24:35.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84852025-05-22T21:24:35.411ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84862025-05-22T21:24:35.411ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84872025-05-22T21:24:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84882025-05-22T21:24:35.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84892025-05-22T21:24:35.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84902025-05-22T21:24:35.415ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84912025-05-22T21:24:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84922025-05-22T21:24:35.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84932025-05-22T21:24:35.417ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84942025-05-22T21:24:35.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84952025-05-22T21:24:35.419ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84962025-05-22T21:24:35.424ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
84972025-05-22T21:24:35.424ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
84982025-05-22T21:24:35.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
84992025-05-22T21:24:35.426ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 341.522761ms iteration = 15 status = 0
85002025-05-22T21:24:35.456ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85012025-05-22T21:24:35.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85022025-05-22T21:24:35.459ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 374.34812ms iteration = 15 status = null
85032025-05-22T21:24:35.460ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85042025-05-22T21:24:35.460ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85052025-05-22T21:24:35.461ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 376.115917ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85062025-05-22T21:24:35.463ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
85072025-05-22T21:24:35.463ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 377.997074ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
85082025-05-22T21:24:35.463ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
85092025-05-22T21:24:35.463ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
85102025-05-22T21:24:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
85112025-05-22T21:24:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85122025-05-22T21:24:35.465ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85132025-05-22T21:24:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85142025-05-22T21:24:35.466ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 381.562958ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
85152025-05-22T21:24:35.466ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
85162025-05-22T21:24:35.466ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
85172025-05-22T21:24:35.466ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85182025-05-22T21:24:35.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad763d3-aefa-4497-80c4-2526dc0d9196 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
85192025-05-22T21:24:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85202025-05-22T21:24:35.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad763d3-aefa-4497-80c4-2526dc0d9196 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
85212025-05-22T21:24:35.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85222025-05-22T21:24:35.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3ad763d3-aefa-4497-80c4-2526dc0d9196 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
85232025-05-22T21:24:35.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
85242025-05-22T21:24:35.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
85252025-05-22T21:24:35.472ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
85262025-05-22T21:24:35.473ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
85272025-05-22T21:24:35.473ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 388.407149ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85282025-05-22T21:24:35.475ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
85292025-05-22T21:24:35.475ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
85302025-05-22T21:24:35.475ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
85312025-05-22T21:24:35.475ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 390.318288ms iteration = 8 status = {"generation":1}
85322025-05-22T21:24:35.476ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
85332025-05-22T21:24:35.476ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
85342025-05-22T21:24:35.476ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4ad00c33-6b8a-4c52-b051-c15773b4530c", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
85352025-05-22T21:24:35.476ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85362025-05-22T21:24:35.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85372025-05-22T21:24:35.478ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85382025-05-22T21:24:35.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85392025-05-22T21:24:35.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85402025-05-22T21:24:35.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85412025-05-22T21:24:35.486ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85422025-05-22T21:24:35.486ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85432025-05-22T21:24:35.486ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a31ff779-8bc2-444e-bbc7-07f765d87302", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
85442025-05-22T21:24:35.488ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 403.634686ms iteration = 15 status = {}
85452025-05-22T21:24:35.498ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
85462025-05-22T21:24:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 413.116767ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
85472025-05-22T21:24:35.508ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
85482025-05-22T21:24:35.508ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
85492025-05-22T21:24:35.508ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85502025-05-22T21:24:35.508ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85512025-05-22T21:24:35.509ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85522025-05-22T21:24:35.512ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
85532025-05-22T21:24:35.512ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
85542025-05-22T21:24:35.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
85552025-05-22T21:24:35.514ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
85562025-05-22T21:24:35.514ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
85572025-05-22T21:24:35.514ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
85582025-05-22T21:24:35.514ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 429.310008ms iteration = 8 status = {"generation":2}
85592025-05-22T21:24:35.517ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 432.291192ms iteration = 15 status = {}
85602025-05-22T21:24:35.561ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85612025-05-22T21:24:35.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85622025-05-22T21:24:35.570ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
85632025-05-22T21:24:35.570ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 485.792119ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85642025-05-22T21:24:35.575ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85652025-05-22T21:24:35.579ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85662025-05-22T21:24:35.579ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85672025-05-22T21:24:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85682025-05-22T21:24:35.586ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85692025-05-22T21:24:35.589ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
85702025-05-22T21:24:35.589ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85712025-05-22T21:24:35.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85722025-05-22T21:24:35.605ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85732025-05-22T21:24:35.667ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85742025-05-22T21:24:35.667ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3dd4eb26-4efe-42a5-8ab1-23591a8e4e6b", "date": "Thu, 22 May 2025 21:24:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85752025-05-22T21:24:35.667ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85762025-05-22T21:24:35.669ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b7645888-4d40-4e28-ba06-1efa42c97dc8", "date": "Thu, 22 May 2025 21:24:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85772025-05-22T21:24:35.669ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85782025-05-22T21:24:35.670ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85792025-05-22T21:24:35.670ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 585.726456ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85802025-05-22T21:24:35.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85812025-05-22T21:24:35.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85822025-05-22T21:24:35.740ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
85832025-05-22T21:24:35.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85842025-05-22T21:24:35.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85852025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85862025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
85872025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85882025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85892025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85902025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85912025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85922025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85932025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85942025-05-22T21:24:35.752ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85952025-05-22T21:24:35.753ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
85962025-05-22T21:24:35.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85972025-05-22T21:24:35.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85982025-05-22T21:24:35.755ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
85992025-05-22T21:24:35.755ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
86002025-05-22T21:24:35.783ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
86012025-05-22T21:24:35.784ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "713b6bf0-c2cd-4876-86f9-58631da8a0de", "date": "Thu, 22 May 2025 21:24:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86022025-05-22T21:24:35.784ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86032025-05-22T21:24:35.786ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "bc0726c6-4871-4565-baef-00612f8a6e8c", "date": "Thu, 22 May 2025 21:24:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86042025-05-22T21:24:35.786ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86052025-05-22T21:24:35.789ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b98e6c5f-a3fc-419a-97eb-b43856124288", "date": "Thu, 22 May 2025 21:24:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86062025-05-22T21:24:35.789ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86072025-05-22T21:24:35.791ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
86082025-05-22T21:24:35.791ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 706.596505ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
86092025-05-22T21:24:35.806ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
86102025-05-22T21:24:35.807ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6fcacd1-1846-4647-9606-988a30e906e4", "content-length": "691", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
86112025-05-22T21:24:35.807ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
86122025-05-22T21:24:35.807ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
86132025-05-22T21:24:35.807ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
86142025-05-22T21:24:35.809ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 724.798395ms iteration = 15 status = {}
86152025-05-22T21:24:35.918ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "40f42a2a-b6fc-418a-a239-84ad69463099", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
86162025-05-22T21:24:35.918ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
86172025-05-22T21:24:35.918ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
86182025-05-22T21:24:35.919ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "920dbefa-75f1-465e-84d3-81b98f3ad871", "content-length": "682", "date": "Thu, 22 May 2025 21:24:35 GMT"} })
86192025-05-22T21:24:35.919ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86202025-05-22T21:24:35.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86212025-05-22T21:24:35.921ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86222025-05-22T21:24:35.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86232025-05-22T21:24:35.925ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86242025-05-22T21:24:35.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86252025-05-22T21:24:35.926ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86262025-05-22T21:24:35.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86272025-05-22T21:24:35.933ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 848.70265ms iteration = 15 status = {}
86282025-05-22T21:24:36.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7d85698-c656-4d04-9df4-67662ac90caa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86292025-05-22T21:24:36.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7d85698-c656-4d04-9df4-67662ac90caa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86302025-05-22T21:24:36.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1814 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f7d85698-c656-4d04-9df4-67662ac90caa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86312025-05-22T21:24:37.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b181885-2999-4729-b039-dddedee02018 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86322025-05-22T21:24:37.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b181885-2999-4729-b039-dddedee02018 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86332025-05-22T21:24:37.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b181885-2999-4729-b039-dddedee02018 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86342025-05-22T21:24:38.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = a555bb55-ff51-434d-b3da-0f7ae9c20613 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
86352025-05-22T21:24:38.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6fae703-08f2-4e6c-b08a-23367ca89477 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86362025-05-22T21:24:38.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6fae703-08f2-4e6c-b08a-23367ca89477 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86372025-05-22T21:24:38.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2717 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6fae703-08f2-4e6c-b08a-23367ca89477 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86382025-05-22T21:24:39.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03ae3ea7-f688-4fd4-9428-003f7c449063 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86392025-05-22T21:24:39.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03ae3ea7-f688-4fd4-9428-003f7c449063 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86402025-05-22T21:24:39.537ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03ae3ea7-f688-4fd4-9428-003f7c449063 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86412025-05-22T21:24:40.551ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fabeb722-0583-4e9e-8b1d-d97f401dea9b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86422025-05-22T21:24:40.552ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fabeb722-0583-4e9e-8b1d-d97f401dea9b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86432025-05-22T21:24:40.554ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2410 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fabeb722-0583-4e9e-8b1d-d97f401dea9b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86442025-05-22T21:24:41.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 802a3004-d71a-437e-9565-54a60888347a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86452025-05-22T21:24:41.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 802a3004-d71a-437e-9565-54a60888347a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86462025-05-22T21:24:41.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1988 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 802a3004-d71a-437e-9565-54a60888347a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86472025-05-22T21:24:42.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e0c99ee-da74-4309-8f39-fd43ac98ff6e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86482025-05-22T21:24:42.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e0c99ee-da74-4309-8f39-fd43ac98ff6e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86492025-05-22T21:24:42.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2628 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e0c99ee-da74-4309-8f39-fd43ac98ff6e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86502025-05-22T21:24:43.597ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9d6462c-1f80-47a7-a3b2-e515758b4936 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86512025-05-22T21:24:43.598ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9d6462c-1f80-47a7-a3b2-e515758b4936 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86522025-05-22T21:24:43.600ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9d6462c-1f80-47a7-a3b2-e515758b4936 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86532025-05-22T21:24:44.614ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe246ad6-90a6-40bc-b57f-3709e92595df roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86542025-05-22T21:24:44.614ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe246ad6-90a6-40bc-b57f-3709e92595df resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86552025-05-22T21:24:44.616ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2031 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fe246ad6-90a6-40bc-b57f-3709e92595df response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86562025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
86572025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86582025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
86592025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86602025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86612025-05-22T21:24:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86622025-05-22T21:24:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86632025-05-22T21:24:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86642025-05-22T21:24:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86652025-05-22T21:24:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86662025-05-22T21:24:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86672025-05-22T21:24:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86682025-05-22T21:24:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86692025-05-22T21:24:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
86702025-05-22T21:24:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86712025-05-22T21:24:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86722025-05-22T21:24:45.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
86732025-05-22T21:24:45.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.50599ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
86742025-05-22T21:24:45.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86752025-05-22T21:24:45.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86762025-05-22T21:24:45.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.004788ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86772025-05-22T21:24:45.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5086b7bd-e26b-49aa-b910-070ca84eb08f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86782025-05-22T21:24:45.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5086b7bd-e26b-49aa-b910-070ca84eb08f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86792025-05-22T21:24:45.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1811 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5086b7bd-e26b-49aa-b910-070ca84eb08f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86802025-05-22T21:24:46.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2d2368b3-3337-40ce-a1ae-eceb490e88a9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86812025-05-22T21:24:46.644ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2d2368b3-3337-40ce-a1ae-eceb490e88a9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86822025-05-22T21:24:46.645ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2d2368b3-3337-40ce-a1ae-eceb490e88a9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86832025-05-22T21:24:47.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67eb1f01-233f-4ca9-b86d-435252e5b95d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86842025-05-22T21:24:47.659ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67eb1f01-233f-4ca9-b86d-435252e5b95d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86852025-05-22T21:24:47.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67eb1f01-233f-4ca9-b86d-435252e5b95d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86862025-05-22T21:24:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = cd397865-9c09-445d-8337-a7c5e272080a response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
86872025-05-22T21:24:48.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c85d9bb-cdf2-4d69-817c-da0d4a0453d0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86882025-05-22T21:24:48.675ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c85d9bb-cdf2-4d69-817c-da0d4a0453d0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86892025-05-22T21:24:48.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4c85d9bb-cdf2-4d69-817c-da0d4a0453d0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86902025-05-22T21:24:49.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2209bc6f-b157-42bc-82fb-6c440e43519a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86912025-05-22T21:24:49.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2209bc6f-b157-42bc-82fb-6c440e43519a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86922025-05-22T21:24:49.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2209bc6f-b157-42bc-82fb-6c440e43519a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86932025-05-22T21:24:50.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b194ec2b-16d0-488a-a8de-a12b668ae218 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86942025-05-22T21:24:50.708ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b194ec2b-16d0-488a-a8de-a12b668ae218 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86952025-05-22T21:24:50.709ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b194ec2b-16d0-488a-a8de-a12b668ae218 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86962025-05-22T21:24:51.723ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb0013ca-6d5e-4dfd-aeb5-8b4c1d4710f0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86972025-05-22T21:24:51.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb0013ca-6d5e-4dfd-aeb5-8b4c1d4710f0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86982025-05-22T21:24:51.725ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb0013ca-6d5e-4dfd-aeb5-8b4c1d4710f0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
86992025-05-22T21:24:52.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfba69de-a91e-4c07-a308-2d359eb0df28 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87002025-05-22T21:24:52.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfba69de-a91e-4c07-a308-2d359eb0df28 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87012025-05-22T21:24:52.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bfba69de-a91e-4c07-a308-2d359eb0df28 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87022025-05-22T21:24:53.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b9d4e5e-8017-49c3-8eb9-5b7ac6ed7b5b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87032025-05-22T21:24:53.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b9d4e5e-8017-49c3-8eb9-5b7ac6ed7b5b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87042025-05-22T21:24:53.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b9d4e5e-8017-49c3-8eb9-5b7ac6ed7b5b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87052025-05-22T21:24:54.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3f7a0f8-9d8a-43e1-87bc-e80d8fceb80c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87062025-05-22T21:24:54.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3f7a0f8-9d8a-43e1-87bc-e80d8fceb80c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87072025-05-22T21:24:54.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3f7a0f8-9d8a-43e1-87bc-e80d8fceb80c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87082025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
87092025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87102025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
87112025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87122025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87132025-05-22T21:24:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87142025-05-22T21:24:55.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87152025-05-22T21:24:55.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87162025-05-22T21:24:55.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87172025-05-22T21:24:55.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.206442ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87182025-05-22T21:24:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87192025-05-22T21:24:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87202025-05-22T21:24:55.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87212025-05-22T21:24:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87222025-05-22T21:24:55.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87232025-05-22T21:24:55.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87242025-05-22T21:24:55.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
87252025-05-22T21:24:55.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87262025-05-22T21:24:55.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87272025-05-22T21:24:55.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
87282025-05-22T21:24:55.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.620977ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
87292025-05-22T21:24:55.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 494358e2-7beb-44f5-a160-5ccaea7f2743 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87302025-05-22T21:24:55.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 494358e2-7beb-44f5-a160-5ccaea7f2743 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87312025-05-22T21:24:55.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2021 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 494358e2-7beb-44f5-a160-5ccaea7f2743 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87322025-05-22T21:24:56.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd971d78-4b1c-4154-8209-a3f41293a14d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87332025-05-22T21:24:56.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd971d78-4b1c-4154-8209-a3f41293a14d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87342025-05-22T21:24:56.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2507 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd971d78-4b1c-4154-8209-a3f41293a14d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87352025-05-22T21:24:57.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 560395b9-9d0f-4e38-b1fd-9ddc4e8a39c7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87362025-05-22T21:24:57.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 560395b9-9d0f-4e38-b1fd-9ddc4e8a39c7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87372025-05-22T21:24:57.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 560395b9-9d0f-4e38-b1fd-9ddc4e8a39c7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87382025-05-22T21:24:58.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 457 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 11449f18-d6bf-4eba-a3f4-fd7d2b80cac7 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
87392025-05-22T21:24:58.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cea839d-e7c7-4518-9335-7f3ed89d87b1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87402025-05-22T21:24:58.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cea839d-e7c7-4518-9335-7f3ed89d87b1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87412025-05-22T21:24:58.835ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2282 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9cea839d-e7c7-4518-9335-7f3ed89d87b1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87422025-05-22T21:24:59.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac0634c-3716-4b19-bfa7-fe3bf2d7c7b9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87432025-05-22T21:24:59.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac0634c-3716-4b19-bfa7-fe3bf2d7c7b9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87442025-05-22T21:24:59.849ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1895 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac0634c-3716-4b19-bfa7-fe3bf2d7c7b9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87452025-05-22T21:25:00.863ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c609cd82-a6da-43b8-a3ee-8e4e85ffbd5b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87462025-05-22T21:25:00.863ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c609cd82-a6da-43b8-a3ee-8e4e85ffbd5b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87472025-05-22T21:25:00.865ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c609cd82-a6da-43b8-a3ee-8e4e85ffbd5b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87482025-05-22T21:25:01.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9e7b7e4-f0d7-4f98-be68-6975f8d21422 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87492025-05-22T21:25:01.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9e7b7e4-f0d7-4f98-be68-6975f8d21422 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87502025-05-22T21:25:01.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9e7b7e4-f0d7-4f98-be68-6975f8d21422 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87512025-05-22T21:25:02.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c4a1c4-4d19-47a5-9f30-65028f09d67c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87522025-05-22T21:25:02.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c4a1c4-4d19-47a5-9f30-65028f09d67c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87532025-05-22T21:25:02.897ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c4a1c4-4d19-47a5-9f30-65028f09d67c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87542025-05-22T21:25:03.911ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0083946d-1d1c-4a7f-9ef7-952e6c9a4e7b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87552025-05-22T21:25:03.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0083946d-1d1c-4a7f-9ef7-952e6c9a4e7b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87562025-05-22T21:25:03.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2429 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0083946d-1d1c-4a7f-9ef7-952e6c9a4e7b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87572025-05-22T21:25:04.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a317d6e5-38c7-4026-a93c-a8b0d4f0b3fb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87582025-05-22T21:25:04.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a317d6e5-38c7-4026-a93c-a8b0d4f0b3fb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87592025-05-22T21:25:04.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1920 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a317d6e5-38c7-4026-a93c-a8b0d4f0b3fb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
87602025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
87612025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
87622025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87632025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87642025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
87652025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
87662025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87672025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
87682025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87692025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87702025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
87712025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87722025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
87732025-05-22T21:25:05.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
87742025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87752025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
87762025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
87772025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87782025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
87792025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87802025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
87812025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87822025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
87832025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
87842025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87852025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87862025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
87872025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87882025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
87892025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
87902025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
87912025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
87922025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
87932025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
87942025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
87952025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
87962025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
87972025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
87982025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87992025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88012025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88022025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88032025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88042025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88052025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88062025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88072025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
88082025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
88092025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88102025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88112025-05-22T21:25:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88122025-05-22T21:25:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
88132025-05-22T21:25:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88142025-05-22T21:25:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88152025-05-22T21:25:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88162025-05-22T21:25:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88172025-05-22T21:25:05.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88182025-05-22T21:25:05.088ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88192025-05-22T21:25:05.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.03242ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
88202025-05-22T21:25:05.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88212025-05-22T21:25:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88222025-05-22T21:25:05.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88232025-05-22T21:25:05.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88242025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
88252025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88262025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
88272025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88282025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88292025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88302025-05-22T21:25:05.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88312025-05-22T21:25:05.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88322025-05-22T21:25:05.098ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88332025-05-22T21:25:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88342025-05-22T21:25:05.099ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 242641357 } })
88352025-05-22T21:25:05.099ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
88362025-05-22T21:25:05.102ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88372025-05-22T21:25:05.104ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 247677002 } })
88382025-05-22T21:25:05.105ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
88392025-05-22T21:25:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
88402025-05-22T21:25:05.105ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88412025-05-22T21:25:05.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88422025-05-22T21:25:05.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88432025-05-22T21:25:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88442025-05-22T21:25:05.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88452025-05-22T21:25:05.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88462025-05-22T21:25:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88472025-05-22T21:25:05.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
88482025-05-22T21:25:05.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88492025-05-22T21:25:05.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88502025-05-22T21:25:05.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
88512025-05-22T21:25:05.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.032454ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
88522025-05-22T21:25:05.147ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88532025-05-22T21:25:05.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88542025-05-22T21:25:05.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88552025-05-22T21:25:05.148ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88562025-05-22T21:25:05.148ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
88572025-05-22T21:25:05.148ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88582025-05-22T21:25:05.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88592025-05-22T21:25:05.150ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88602025-05-22T21:25:05.150ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88612025-05-22T21:25:05.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88622025-05-22T21:25:05.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88632025-05-22T21:25:05.151ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88642025-05-22T21:25:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88652025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 68.677212ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
88662025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
88672025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88682025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88692025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88702025-05-22T21:25:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88712025-05-22T21:25:05.155ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88722025-05-22T21:25:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88732025-05-22T21:25:05.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88742025-05-22T21:25:05.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88752025-05-22T21:25:05.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88762025-05-22T21:25:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88772025-05-22T21:25:05.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88782025-05-22T21:25:05.156ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1414, tv_nsec: 299914270 } })
88792025-05-22T21:25:05.157ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
88802025-05-22T21:25:05.159ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
88812025-05-22T21:25:05.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88822025-05-22T21:25:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88832025-05-22T21:25:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
88842025-05-22T21:25:05.160ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88852025-05-22T21:25:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88862025-05-22T21:25:05.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
88872025-05-22T21:25:05.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88882025-05-22T21:25:05.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88892025-05-22T21:25:05.165ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
88902025-05-22T21:25:05.165ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 80.417657ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
88912025-05-22T21:25:05.165ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
88922025-05-22T21:25:05.165ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
88932025-05-22T21:25:05.166ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3b43fa2f-341e-419f-8418-04e1691e07d9", "content-length": "26", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
88942025-05-22T21:25:05.166ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
88952025-05-22T21:25:05.166ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88962025-05-22T21:25:05.166ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
88972025-05-22T21:25:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88982025-05-22T21:25:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
88992025-05-22T21:25:05.167ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 81.763267ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
89002025-05-22T21:25:05.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
89012025-05-22T21:25:05.167ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 82.272085ms iteration = 16 status = 0
89022025-05-22T21:25:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89032025-05-22T21:25:05.168ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89042025-05-22T21:25:05.168ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89052025-05-22T21:25:05.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 83.430091ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
89062025-05-22T21:25:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
89072025-05-22T21:25:05.172ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
89082025-05-22T21:25:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
89092025-05-22T21:25:05.197ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
89102025-05-22T21:25:05.197ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89112025-05-22T21:25:05.198ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6aa3c6c-1969-42dc-b7bf-f984d4ef5506", "content-length": "26", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89122025-05-22T21:25:05.198ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89132025-05-22T21:25:05.200ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
89142025-05-22T21:25:05.203ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89152025-05-22T21:25:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89162025-05-22T21:25:05.204ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89172025-05-22T21:25:05.204ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
89182025-05-22T21:25:05.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89192025-05-22T21:25:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89202025-05-22T21:25:05.206ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.081402ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89212025-05-22T21:25:05.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.31567ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89222025-05-22T21:25:05.217ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 132.521742ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
89232025-05-22T21:25:05.218ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
89242025-05-22T21:25:05.218ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 133.146521ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
89252025-05-22T21:25:05.239ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 154.228345ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
89262025-05-22T21:25:05.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89272025-05-22T21:25:05.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89282025-05-22T21:25:05.249ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89292025-05-22T21:25:05.249ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
89302025-05-22T21:25:05.249ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 163.759767ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
89312025-05-22T21:25:05.291ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 206.217728ms iteration = 18 status = {"physical_disks_added":0}
89322025-05-22T21:25:05.297ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89332025-05-22T21:25:05.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89342025-05-22T21:25:05.300ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 214.99441ms iteration = 16 status = null
89352025-05-22T21:25:05.302ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
89362025-05-22T21:25:05.302ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
89372025-05-22T21:25:05.302ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56732908-b54f-4a92-a471-1ac4a0e8ae42", "content-length": "26", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89382025-05-22T21:25:05.302ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
89392025-05-22T21:25:05.304ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
89402025-05-22T21:25:05.343ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 258.300044ms iteration = 16 status = {}
89412025-05-22T21:25:05.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89422025-05-22T21:25:05.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89432025-05-22T21:25:05.355ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
89442025-05-22T21:25:05.355ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89452025-05-22T21:25:05.355ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "5b376c09-7db5-458e-8cdb-b7f675fbe964", "content-length": "372", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89462025-05-22T21:25:05.355ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89472025-05-22T21:25:05.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89482025-05-22T21:25:05.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89492025-05-22T21:25:05.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89502025-05-22T21:25:05.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89512025-05-22T21:25:05.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89522025-05-22T21:25:05.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89532025-05-22T21:25:05.363ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
89542025-05-22T21:25:05.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89552025-05-22T21:25:05.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89562025-05-22T21:25:05.370ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
89572025-05-22T21:25:05.370ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
89582025-05-22T21:25:05.370ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "381c5b23-ac87-4050-b1ca-f2364d95e1c8", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89592025-05-22T21:25:05.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89602025-05-22T21:25:05.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89612025-05-22T21:25:05.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89622025-05-22T21:25:05.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89632025-05-22T21:25:05.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89642025-05-22T21:25:05.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89652025-05-22T21:25:05.379ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
89662025-05-22T21:25:05.379ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
89672025-05-22T21:25:05.379ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b9462eca-3ff6-469f-9180-0f4b70d14b29", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89682025-05-22T21:25:05.381ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 296.213338ms iteration = 16 status = {}
89692025-05-22T21:25:05.476ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
89702025-05-22T21:25:05.476ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "791378ce-5282-4944-8578-06de26dc9d36", "content-length": "691", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89712025-05-22T21:25:05.476ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
89722025-05-22T21:25:05.477ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
89732025-05-22T21:25:05.477ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
89742025-05-22T21:25:05.478ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.955328ms iteration = 16 status = {}
89752025-05-22T21:25:05.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89762025-05-22T21:25:05.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89772025-05-22T21:25:05.514ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
89782025-05-22T21:25:05.514ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89792025-05-22T21:25:05.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89802025-05-22T21:25:05.525ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
89812025-05-22T21:25:05.525ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
89822025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
89832025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
89842025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89852025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89862025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89872025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89882025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
89892025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
89902025-05-22T21:25:05.526ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
89912025-05-22T21:25:05.526ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89922025-05-22T21:25:05.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89932025-05-22T21:25:05.529ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
89942025-05-22T21:25:05.529ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
89952025-05-22T21:25:05.718ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1b19ba65-ab3f-4ef0-9c5e-554bdabd2c84", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89962025-05-22T21:25:05.718ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
89972025-05-22T21:25:05.718ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
89982025-05-22T21:25:05.718ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f843f67c-92ff-4e1d-b1d6-ef46ccf294b4", "content-length": "682", "date": "Thu, 22 May 2025 21:25:05 GMT"} })
89992025-05-22T21:25:05.718ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90002025-05-22T21:25:05.718ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90012025-05-22T21:25:05.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90022025-05-22T21:25:05.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90032025-05-22T21:25:05.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90042025-05-22T21:25:05.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90052025-05-22T21:25:05.727ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90062025-05-22T21:25:05.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90072025-05-22T21:25:05.735ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 649.837221ms iteration = 16 status = {}
90082025-05-22T21:25:05.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 10165197-5854-4a60-aa88-fff6d131d56a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90092025-05-22T21:25:05.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 10165197-5854-4a60-aa88-fff6d131d56a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90102025-05-22T21:25:05.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 10165197-5854-4a60-aa88-fff6d131d56a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90112025-05-22T21:25:06.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6e89c3f-c3ad-4924-ae04-73739edebac2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90122025-05-22T21:25:06.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6e89c3f-c3ad-4924-ae04-73739edebac2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90132025-05-22T21:25:06.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2829 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6e89c3f-c3ad-4924-ae04-73739edebac2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90142025-05-22T21:25:07.976ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa73f6ad-e74a-48c8-b8ed-8a0b8f7d8a06 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90152025-05-22T21:25:07.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa73f6ad-e74a-48c8-b8ed-8a0b8f7d8a06 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90162025-05-22T21:25:07.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa73f6ad-e74a-48c8-b8ed-8a0b8f7d8a06 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90172025-05-22T21:25:08.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 553 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 8c04ba70-7d97-478d-80c7-2c382a4dd298 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
90182025-05-22T21:25:08.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e1485b00-ee2d-4afe-9ad5-e940d33d74af roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90192025-05-22T21:25:08.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e1485b00-ee2d-4afe-9ad5-e940d33d74af resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90202025-05-22T21:25:08.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e1485b00-ee2d-4afe-9ad5-e940d33d74af response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90212025-05-22T21:25:10.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b1fdcf9-f661-44ea-bff5-f16cb7161fca roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90222025-05-22T21:25:10.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b1fdcf9-f661-44ea-bff5-f16cb7161fca resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90232025-05-22T21:25:10.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b1fdcf9-f661-44ea-bff5-f16cb7161fca response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90242025-05-22T21:25:11.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a0696135-8a26-428c-85bd-e48f7a63a0bd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90252025-05-22T21:25:11.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a0696135-8a26-428c-85bd-e48f7a63a0bd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90262025-05-22T21:25:11.024ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1794 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a0696135-8a26-428c-85bd-e48f7a63a0bd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90272025-05-22T21:25:12.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1f3b045-72a9-4018-b09c-4169450eb868 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90282025-05-22T21:25:12.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1f3b045-72a9-4018-b09c-4169450eb868 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90292025-05-22T21:25:12.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2639 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1f3b045-72a9-4018-b09c-4169450eb868 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90302025-05-22T21:25:13.055ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 63828471-2f87-49b3-9b57-6bf5b4596e9b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90312025-05-22T21:25:13.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 63828471-2f87-49b3-9b57-6bf5b4596e9b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90322025-05-22T21:25:13.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 63828471-2f87-49b3-9b57-6bf5b4596e9b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90332025-05-22T21:25:14.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03fe8ee5-9f2e-465e-bea4-1e66c3d7d958 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90342025-05-22T21:25:14.072ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03fe8ee5-9f2e-465e-bea4-1e66c3d7d958 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90352025-05-22T21:25:14.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 03fe8ee5-9f2e-465e-bea4-1e66c3d7d958 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90362025-05-22T21:25:15.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
90372025-05-22T21:25:15.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
90382025-05-22T21:25:15.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90392025-05-22T21:25:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90402025-05-22T21:25:15.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90412025-05-22T21:25:15.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90422025-05-22T21:25:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90432025-05-22T21:25:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90442025-05-22T21:25:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90452025-05-22T21:25:15.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 638a33f6-49c6-4319-b5ca-bd11de9dba22 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90462025-05-22T21:25:15.088ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 638a33f6-49c6-4319-b5ca-bd11de9dba22 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90472025-05-22T21:25:15.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.487592ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90482025-05-22T21:25:15.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 638a33f6-49c6-4319-b5ca-bd11de9dba22 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90492025-05-22T21:25:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90502025-05-22T21:25:15.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90512025-05-22T21:25:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90522025-05-22T21:25:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90532025-05-22T21:25:15.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90542025-05-22T21:25:15.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90552025-05-22T21:25:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
90562025-05-22T21:25:15.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90572025-05-22T21:25:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90582025-05-22T21:25:15.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
90592025-05-22T21:25:15.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.269391ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
90602025-05-22T21:25:16.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 939c32e8-d937-4768-a3cd-840b2aac3d2d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90612025-05-22T21:25:16.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 939c32e8-d937-4768-a3cd-840b2aac3d2d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90622025-05-22T21:25:16.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2339 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 939c32e8-d937-4768-a3cd-840b2aac3d2d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90632025-05-22T21:25:17.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7194de3d-669a-488e-84da-4a140cbb6131 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90642025-05-22T21:25:17.120ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7194de3d-669a-488e-84da-4a140cbb6131 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90652025-05-22T21:25:17.122ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7194de3d-669a-488e-84da-4a140cbb6131 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90662025-05-22T21:25:18.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6a1af3c-2f95-454f-8009-730415fb4394 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90672025-05-22T21:25:18.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6a1af3c-2f95-454f-8009-730415fb4394 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90682025-05-22T21:25:18.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6a1af3c-2f95-454f-8009-730415fb4394 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90692025-05-22T21:25:18.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:59999
90702025-05-22T21:25:18.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = 5c2e7de5-1951-4672-8438-119064c1ec55 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
90712025-05-22T21:25:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = 5c2e7de5-1951-4672-8438-119064c1ec55 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
90722025-05-22T21:25:18.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = 5c2e7de5-1951-4672-8438-119064c1ec55 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
90732025-05-22T21:25:18.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = bf259935-6837-4b2d-9739-6296bd5d4f7e roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
90742025-05-22T21:25:18.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = bf259935-6837-4b2d-9739-6296bd5d4f7e resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
90752025-05-22T21:25:18.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:59999 req_id = bf259935-6837-4b2d-9739-6296bd5d4f7e response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
90762025-05-22T21:25:18.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 544 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = c8aebf2e-b45b-4710-9da5-749432e97c7d response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
90772025-05-22T21:25:19.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 797762ed-f7ec-4d51-99df-3065be4b7a88 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90782025-05-22T21:25:19.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 797762ed-f7ec-4d51-99df-3065be4b7a88 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90792025-05-22T21:25:19.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 797762ed-f7ec-4d51-99df-3065be4b7a88 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90802025-05-22T21:25:20.167ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b72e6e8-7470-4a0d-a374-fe976288dab3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90812025-05-22T21:25:20.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b72e6e8-7470-4a0d-a374-fe976288dab3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90822025-05-22T21:25:20.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2143 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b72e6e8-7470-4a0d-a374-fe976288dab3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90832025-05-22T21:25:21.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 890c4747-7632-47ce-a3fe-ddeaae4d41d8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90842025-05-22T21:25:21.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 890c4747-7632-47ce-a3fe-ddeaae4d41d8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90852025-05-22T21:25:21.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2771 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 890c4747-7632-47ce-a3fe-ddeaae4d41d8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90862025-05-22T21:25:22.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2aca54ef-d406-44f0-8ff9-f7c4172b87f9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90872025-05-22T21:25:22.200ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2aca54ef-d406-44f0-8ff9-f7c4172b87f9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90882025-05-22T21:25:22.201ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2aca54ef-d406-44f0-8ff9-f7c4172b87f9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90892025-05-22T21:25:23.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d0eff93-28b1-4681-b105-3aa52aeb40f5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90902025-05-22T21:25:23.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d0eff93-28b1-4681-b105-3aa52aeb40f5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90912025-05-22T21:25:23.217ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1897 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4d0eff93-28b1-4681-b105-3aa52aeb40f5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90922025-05-22T21:25:24.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3df6e4e-4acb-45b4-87cd-ed2d8d0e00e1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90932025-05-22T21:25:24.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3df6e4e-4acb-45b4-87cd-ed2d8d0e00e1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90942025-05-22T21:25:24.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2672 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e3df6e4e-4acb-45b4-87cd-ed2d8d0e00e1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
90952025-05-22T21:25:25.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
90962025-05-22T21:25:25.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
90972025-05-22T21:25:25.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90982025-05-22T21:25:25.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90992025-05-22T21:25:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91002025-05-22T21:25:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91012025-05-22T21:25:25.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91022025-05-22T21:25:25.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91032025-05-22T21:25:25.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91042025-05-22T21:25:25.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.679681ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
91052025-05-22T21:25:25.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91062025-05-22T21:25:25.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91072025-05-22T21:25:25.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91082025-05-22T21:25:25.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91092025-05-22T21:25:25.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91102025-05-22T21:25:25.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91112025-05-22T21:25:25.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
91122025-05-22T21:25:25.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91132025-05-22T21:25:25.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91142025-05-22T21:25:25.139ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
91152025-05-22T21:25:25.139ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.376779ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
91162025-05-22T21:25:25.246ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3923d05-9c44-4a92-a127-01460e5e1e9d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91172025-05-22T21:25:25.246ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3923d05-9c44-4a92-a127-01460e5e1e9d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91182025-05-22T21:25:25.248ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c3923d05-9c44-4a92-a127-01460e5e1e9d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91192025-05-22T21:25:26.261ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95b888f5-558c-4d01-8e7a-497b93b2b256 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91202025-05-22T21:25:26.261ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95b888f5-558c-4d01-8e7a-497b93b2b256 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91212025-05-22T21:25:26.263ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 95b888f5-558c-4d01-8e7a-497b93b2b256 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91222025-05-22T21:25:27.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b2124f9-1bbd-4c9a-ae27-022f3762e159 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91232025-05-22T21:25:27.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b2124f9-1bbd-4c9a-ae27-022f3762e159 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91242025-05-22T21:25:27.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0b2124f9-1bbd-4c9a-ae27-022f3762e159 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91252025-05-22T21:25:28.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 504 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 85f00983-0b07-4421-8d73-6ff9b05d2314 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
91262025-05-22T21:25:28.291ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56ea07c-ebb9-45ba-a6fd-0c5355f80458 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91272025-05-22T21:25:28.291ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56ea07c-ebb9-45ba-a6fd-0c5355f80458 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91282025-05-22T21:25:28.293ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2263 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e56ea07c-ebb9-45ba-a6fd-0c5355f80458 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91292025-05-22T21:25:29.306ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 627512f7-79d7-47e8-a2b5-a71784b2f0e7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91302025-05-22T21:25:29.306ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 627512f7-79d7-47e8-a2b5-a71784b2f0e7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91312025-05-22T21:25:29.308ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 627512f7-79d7-47e8-a2b5-a71784b2f0e7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91322025-05-22T21:25:30.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac1878c5-871c-4677-b0c3-c811797521d8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91332025-05-22T21:25:30.321ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac1878c5-871c-4677-b0c3-c811797521d8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91342025-05-22T21:25:30.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ac1878c5-871c-4677-b0c3-c811797521d8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91352025-05-22T21:25:31.336ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 778fe29d-3763-426a-b699-f4d85139b157 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91362025-05-22T21:25:31.337ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 778fe29d-3763-426a-b699-f4d85139b157 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91372025-05-22T21:25:31.339ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 778fe29d-3763-426a-b699-f4d85139b157 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91382025-05-22T21:25:32.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f948b59-d993-4863-b845-823b28cc8b18 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91392025-05-22T21:25:32.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f948b59-d993-4863-b845-823b28cc8b18 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91402025-05-22T21:25:32.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1953 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f948b59-d993-4863-b845-823b28cc8b18 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91412025-05-22T21:25:33.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60b09e9f-d714-4b28-8a6c-dd788d92390e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91422025-05-22T21:25:33.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60b09e9f-d714-4b28-8a6c-dd788d92390e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91432025-05-22T21:25:33.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2566 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 60b09e9f-d714-4b28-8a6c-dd788d92390e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91442025-05-22T21:25:34.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13366cc7-2dfc-4be2-82f2-8ba8c31eca7b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91452025-05-22T21:25:34.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13366cc7-2dfc-4be2-82f2-8ba8c31eca7b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91462025-05-22T21:25:34.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2215 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13366cc7-2dfc-4be2-82f2-8ba8c31eca7b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
91472025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
91482025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
91492025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
91502025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91512025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
91522025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
91532025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91542025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
91552025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
91562025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
91572025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
91582025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
91592025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
91602025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
91612025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91622025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
91632025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91642025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
91652025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91662025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
91672025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
91682025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
91692025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91702025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
91712025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91722025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
91732025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91742025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
91752025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91762025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
91772025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91782025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
91792025-05-22T21:25:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
91802025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91812025-05-22T21:25:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
91822025-05-22T21:25:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
91832025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91842025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
91852025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91862025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
91872025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
91882025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
91892025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91902025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
91912025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
91922025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91932025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
91942025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
91952025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
91962025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
91972025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
91982025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
91992025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
92002025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
92012025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
92022025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92032025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
92042025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92052025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92062025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 9 reason = Timeout
92072025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
92082025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
92092025-05-22T21:25:35.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:15:35.085996619 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
92102025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
92112025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
92122025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
92132025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
92142025-05-22T21:25:35.086ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
92152025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
92162025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.99\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
92172025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
92182025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
92192025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92202025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92212025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92222025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92232025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92242025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92252025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92262025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92272025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92282025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92292025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92302025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
92312025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92322025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92332025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
92342025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
92352025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92362025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92372025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
92382025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
92392025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92402025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
92412025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92422025-05-22T21:25:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 229516961 } })
92432025-05-22T21:25:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 229530801 } })
92442025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 9 reason = Timeout
92452025-05-22T21:25:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
92462025-05-22T21:25:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
92472025-05-22T21:25:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
92482025-05-22T21:25:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.29061ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
92492025-05-22T21:25:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
92502025-05-22T21:25:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.38276ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
92512025-05-22T21:25:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.195338ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
92522025-05-22T21:25:35.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92532025-05-22T21:25:35.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.281333ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
92542025-05-22T21:25:35.094ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 8.951483ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
92552025-05-22T21:25:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92562025-05-22T21:25:35.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92572025-05-22T21:25:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92582025-05-22T21:25:35.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 242951891 } })
92592025-05-22T21:25:35.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
92602025-05-22T21:25:35.100ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 243731402 } })
92612025-05-22T21:25:35.101ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
92622025-05-22T21:25:35.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92632025-05-22T21:25:35.103ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642025-05-22T21:25:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92652025-05-22T21:25:35.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92662025-05-22T21:25:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92672025-05-22T21:25:35.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92682025-05-22T21:25:35.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92692025-05-22T21:25:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92702025-05-22T21:25:35.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92712025-05-22T21:25:35.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92722025-05-22T21:25:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92732025-05-22T21:25:35.114ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 28.984821ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
92742025-05-22T21:25:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
92752025-05-22T21:25:35.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92762025-05-22T21:25:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92772025-05-22T21:25:35.120ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92782025-05-22T21:25:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92792025-05-22T21:25:35.123ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:15:35.085996619 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
92802025-05-22T21:25:35.123ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 37.329185ms iteration = 9 status = {"expiration":"2025-05-22T21:15:35.085996619Z","pruned":[]}
92812025-05-22T21:25:35.123ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822025-05-22T21:25:35.124ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
92832025-05-22T21:25:35.124ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 38.030816ms iteration = 9 status = {"by_rx":{},"error":null}
92842025-05-22T21:25:35.127ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92852025-05-22T21:25:35.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92862025-05-22T21:25:35.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92872025-05-22T21:25:35.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92882025-05-22T21:25:35.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92892025-05-22T21:25:35.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92902025-05-22T21:25:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92912025-05-22T21:25:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92922025-05-22T21:25:35.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92932025-05-22T21:25:35.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92942025-05-22T21:25:35.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92952025-05-22T21:25:35.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92962025-05-22T21:25:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92972025-05-22T21:25:35.158ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
92982025-05-22T21:25:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
92992025-05-22T21:25:35.168ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93002025-05-22T21:25:35.168ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93012025-05-22T21:25:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93022025-05-22T21:25:35.173ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93032025-05-22T21:25:35.173ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93042025-05-22T21:25:35.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93052025-05-22T21:25:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93062025-05-22T21:25:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93072025-05-22T21:25:35.175ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93082025-05-22T21:25:35.175ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93092025-05-22T21:25:35.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93102025-05-22T21:25:35.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93112025-05-22T21:25:35.179ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93122025-05-22T21:25:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93132025-05-22T21:25:35.179ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93142025-05-22T21:25:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93152025-05-22T21:25:35.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93162025-05-22T21:25:35.180ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93172025-05-22T21:25:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93182025-05-22T21:25:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
93192025-05-22T21:25:35.180ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
93202025-05-22T21:25:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
93212025-05-22T21:25:35.181ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 95.474401ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
93222025-05-22T21:25:35.182ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93232025-05-22T21:25:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93242025-05-22T21:25:35.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93252025-05-22T21:25:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93262025-05-22T21:25:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
93272025-05-22T21:25:35.184ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93282025-05-22T21:25:35.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93292025-05-22T21:25:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93302025-05-22T21:25:35.186ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93312025-05-22T21:25:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93322025-05-22T21:25:35.187ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 101.438479ms iteration = 9 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
93332025-05-22T21:25:35.189ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93342025-05-22T21:25:35.189ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93352025-05-22T21:25:35.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93362025-05-22T21:25:35.189ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93372025-05-22T21:25:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93382025-05-22T21:25:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93392025-05-22T21:25:35.191ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
93402025-05-22T21:25:35.191ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
93412025-05-22T21:25:35.191ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 105.554621ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
93422025-05-22T21:25:35.192ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93432025-05-22T21:25:35.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93442025-05-22T21:25:35.194ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1444, tv_nsec: 337663089 } })
93452025-05-22T21:25:35.195ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
93462025-05-22T21:25:35.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 110.140158ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93472025-05-22T21:25:35.196ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93482025-05-22T21:25:35.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93492025-05-22T21:25:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93502025-05-22T21:25:35.199ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93512025-05-22T21:25:35.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93522025-05-22T21:25:35.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93532025-05-22T21:25:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93542025-05-22T21:25:35.204ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
93552025-05-22T21:25:35.214ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.06179ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93562025-05-22T21:25:35.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
93572025-05-22T21:25:35.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.910911ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
93582025-05-22T21:25:35.228ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93592025-05-22T21:25:35.228ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 142.756183ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93602025-05-22T21:25:35.229ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
93612025-05-22T21:25:35.243ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93622025-05-22T21:25:35.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93632025-05-22T21:25:35.246ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93642025-05-22T21:25:35.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93652025-05-22T21:25:35.251ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
93662025-05-22T21:25:35.253ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93672025-05-22T21:25:35.255ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
93682025-05-22T21:25:35.255ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
93692025-05-22T21:25:35.255ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
93702025-05-22T21:25:35.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93712025-05-22T21:25:35.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93722025-05-22T21:25:35.258ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93732025-05-22T21:25:35.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93742025-05-22T21:25:35.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93752025-05-22T21:25:35.258ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93762025-05-22T21:25:35.258ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93772025-05-22T21:25:35.258ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 172.947643ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93782025-05-22T21:25:35.259ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
93792025-05-22T21:25:35.259ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
93802025-05-22T21:25:35.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
93812025-05-22T21:25:35.260ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 174.852612ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93822025-05-22T21:25:35.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 175.898347ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
93832025-05-22T21:25:35.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93842025-05-22T21:25:35.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93852025-05-22T21:25:35.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93862025-05-22T21:25:35.264ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93872025-05-22T21:25:35.266ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93882025-05-22T21:25:35.266ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93892025-05-22T21:25:35.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93902025-05-22T21:25:35.269ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
93912025-05-22T21:25:35.269ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
93922025-05-22T21:25:35.269ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 183.47299ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
93932025-05-22T21:25:35.269ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 184.053818ms iteration = 19 status = {"physical_disks_added":0}
93942025-05-22T21:25:35.277ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
93952025-05-22T21:25:35.277ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
93962025-05-22T21:25:35.277ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
93972025-05-22T21:25:35.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
93982025-05-22T21:25:35.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
93992025-05-22T21:25:35.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94002025-05-22T21:25:35.279ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
94012025-05-22T21:25:35.279ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94022025-05-22T21:25:35.280ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dd945b2-1535-4ab6-86e3-9d5cd0fc3d9c", "content-length": "26", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94032025-05-22T21:25:35.280ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94042025-05-22T21:25:35.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94052025-05-22T21:25:35.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94062025-05-22T21:25:35.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94072025-05-22T21:25:35.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94082025-05-22T21:25:35.304ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94092025-05-22T21:25:35.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
94102025-05-22T21:25:35.307ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94112025-05-22T21:25:35.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94122025-05-22T21:25:35.310ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 225.227111ms iteration = 17 status = 0
94132025-05-22T21:25:35.318ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94142025-05-22T21:25:35.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94152025-05-22T21:25:35.320ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162025-05-22T21:25:35.322ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
94172025-05-22T21:25:35.322ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 236.695461ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
94182025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
94192025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
94202025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94212025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
94222025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
94232025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94242025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94252025-05-22T21:25:35.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
94262025-05-22T21:25:35.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94272025-05-22T21:25:35.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94282025-05-22T21:25:35.330ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
94292025-05-22T21:25:35.330ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
94302025-05-22T21:25:35.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
94312025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
94322025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
94332025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
94342025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 247.206218ms iteration = 9 status = {"generation":2}
94352025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
94362025-05-22T21:25:35.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
94372025-05-22T21:25:35.340ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
94382025-05-22T21:25:35.340ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
94392025-05-22T21:25:35.340ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94402025-05-22T21:25:35.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94412025-05-22T21:25:35.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94422025-05-22T21:25:35.345ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
94432025-05-22T21:25:35.345ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94442025-05-22T21:25:35.345ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ebf8aa6-14d9-4049-807b-0d008253cc27", "content-length": "26", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94452025-05-22T21:25:35.345ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94462025-05-22T21:25:35.347ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
94472025-05-22T21:25:35.347ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
94482025-05-22T21:25:35.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
94492025-05-22T21:25:35.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94502025-05-22T21:25:35.351ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
94512025-05-22T21:25:35.351ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
94522025-05-22T21:25:35.351ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
94532025-05-22T21:25:35.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 265.191865ms iteration = 9 status = {"generation":1}
94542025-05-22T21:25:35.374ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
94552025-05-22T21:25:35.374ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 288.541523ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
94562025-05-22T21:25:35.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab2a707b-d9d1-4f83-8a06-470414209080 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
94572025-05-22T21:25:35.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab2a707b-d9d1-4f83-8a06-470414209080 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
94582025-05-22T21:25:35.408ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab2a707b-d9d1-4f83-8a06-470414209080 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
94592025-05-22T21:25:35.428ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94602025-05-22T21:25:35.429ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94612025-05-22T21:25:35.429ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d76a888-9c0e-486f-9147-75107068505c", "content-length": "372", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94622025-05-22T21:25:35.429ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94632025-05-22T21:25:35.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94642025-05-22T21:25:35.433ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
94652025-05-22T21:25:35.434ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "1b3c7b89-20c1-4648-b043-941e6bc457b3", "date": "Thu, 22 May 2025 21:25:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
94662025-05-22T21:25:35.434ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
94672025-05-22T21:25:35.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9bb74d12-8f28-4e3e-b824-34a7188d1b48", "date": "Thu, 22 May 2025 21:25:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
94682025-05-22T21:25:35.436ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
94692025-05-22T21:25:35.438ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
94702025-05-22T21:25:35.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 352.424614ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
94712025-05-22T21:25:35.440ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
94722025-05-22T21:25:35.452ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94732025-05-22T21:25:35.452ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94742025-05-22T21:25:35.452ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "14450f68-7631-420c-bfac-eedbbaa390e4", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94752025-05-22T21:25:35.452ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94762025-05-22T21:25:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94772025-05-22T21:25:35.453ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
94782025-05-22T21:25:35.453ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94792025-05-22T21:25:35.454ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b808fa0-02db-42ab-a0b6-73e68ee66b1c", "content-length": "26", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94802025-05-22T21:25:35.454ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94812025-05-22T21:25:35.455ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94822025-05-22T21:25:35.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94832025-05-22T21:25:35.456ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
94842025-05-22T21:25:35.460ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94852025-05-22T21:25:35.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94862025-05-22T21:25:35.465ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94872025-05-22T21:25:35.465ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94882025-05-22T21:25:35.465ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "20d3aa26-04ab-4471-a791-7b8df4264b7b", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
94892025-05-22T21:25:35.466ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94902025-05-22T21:25:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94912025-05-22T21:25:35.467ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 381.658819ms iteration = 17 status = {}
94922025-05-22T21:25:35.487ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94932025-05-22T21:25:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94942025-05-22T21:25:35.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.170264ms iteration = 17 status = null
94952025-05-22T21:25:35.491ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.302256ms iteration = 17 status = {}
94962025-05-22T21:25:35.500ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
94972025-05-22T21:25:35.500ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 414.580289ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
94982025-05-22T21:25:35.514ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94992025-05-22T21:25:35.517ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95002025-05-22T21:25:35.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95012025-05-22T21:25:35.517ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
95022025-05-22T21:25:35.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95032025-05-22T21:25:35.518ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "0bfcc32c-4901-4ac8-9ea6-05ad9aec02c8", "date": "Thu, 22 May 2025 21:25:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95042025-05-22T21:25:35.518ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95052025-05-22T21:25:35.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95062025-05-22T21:25:35.520ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b1a3ac7f-e9a6-431c-92f1-56de8fa9dd7d", "date": "Thu, 22 May 2025 21:25:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95072025-05-22T21:25:35.520ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95082025-05-22T21:25:35.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1458c249-8783-48ff-ae44-d9d47d6fe74d", "date": "Thu, 22 May 2025 21:25:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95092025-05-22T21:25:35.522ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95102025-05-22T21:25:35.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
95112025-05-22T21:25:35.522ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95122025-05-22T21:25:35.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
95132025-05-22T21:25:35.524ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
95142025-05-22T21:25:35.524ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 438.220211ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
95152025-05-22T21:25:35.585ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95162025-05-22T21:25:35.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95172025-05-22T21:25:35.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95182025-05-22T21:25:35.638ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
95192025-05-22T21:25:35.638ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95202025-05-22T21:25:35.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95212025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95222025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
95232025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95242025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95252025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95262025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95272025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95282025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95292025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95302025-05-22T21:25:35.653ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95312025-05-22T21:25:35.654ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
95322025-05-22T21:25:35.654ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95332025-05-22T21:25:35.654ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95342025-05-22T21:25:35.657ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
95352025-05-22T21:25:35.657ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95362025-05-22T21:25:35.717ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "313f8317-e80b-4478-98e9-aca50e7127f6", "content-length": "691", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
95372025-05-22T21:25:35.717ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
95382025-05-22T21:25:35.717ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
95392025-05-22T21:25:35.717ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
95402025-05-22T21:25:35.720ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 634.532882ms iteration = 17 status = {}
95412025-05-22T21:25:35.825ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9a97c00f-7794-4dc7-96dc-6d191f482ce4", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
95422025-05-22T21:25:35.825ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
95432025-05-22T21:25:35.825ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95442025-05-22T21:25:35.826ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1510bbc-2b88-4c87-8e08-4aea4ab0c518", "content-length": "682", "date": "Thu, 22 May 2025 21:25:35 GMT"} })
95452025-05-22T21:25:35.826ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95462025-05-22T21:25:35.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95472025-05-22T21:25:35.830ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95482025-05-22T21:25:35.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95492025-05-22T21:25:35.834ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95502025-05-22T21:25:35.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95512025-05-22T21:25:35.837ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95522025-05-22T21:25:35.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95532025-05-22T21:25:35.844ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 758.418456ms iteration = 17 status = {}
95542025-05-22T21:25:36.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 183c6de5-47ee-4696-a67d-22f3022a48f0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95552025-05-22T21:25:36.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 183c6de5-47ee-4696-a67d-22f3022a48f0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95562025-05-22T21:25:36.429ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 183c6de5-47ee-4696-a67d-22f3022a48f0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95572025-05-22T21:25:37.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4783d970-222f-4d95-af7b-dc07679c659f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95582025-05-22T21:25:37.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4783d970-222f-4d95-af7b-dc07679c659f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95592025-05-22T21:25:37.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4783d970-222f-4d95-af7b-dc07679c659f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95602025-05-22T21:25:38.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 543 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = cf9d9057-4c40-4cc7-a41a-11e4142ad9b4 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
95612025-05-22T21:25:38.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab56c0ac-9bd7-40e0-8923-3cf502414f1b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95622025-05-22T21:25:38.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab56c0ac-9bd7-40e0-8923-3cf502414f1b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95632025-05-22T21:25:38.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab56c0ac-9bd7-40e0-8923-3cf502414f1b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95642025-05-22T21:25:39.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f9b774c-cc2c-4a57-9f08-d819fa7d59ff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95652025-05-22T21:25:39.474ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f9b774c-cc2c-4a57-9f08-d819fa7d59ff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95662025-05-22T21:25:39.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1f9b774c-cc2c-4a57-9f08-d819fa7d59ff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95672025-05-22T21:25:40.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a576d9-80e0-45c1-b037-abfad6c20061 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95682025-05-22T21:25:40.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a576d9-80e0-45c1-b037-abfad6c20061 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95692025-05-22T21:25:40.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a576d9-80e0-45c1-b037-abfad6c20061 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95702025-05-22T21:25:41.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2047584a-6b4f-4f05-a82c-d90be928e445 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95712025-05-22T21:25:41.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2047584a-6b4f-4f05-a82c-d90be928e445 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95722025-05-22T21:25:41.507ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2047584a-6b4f-4f05-a82c-d90be928e445 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95732025-05-22T21:25:42.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77b38b3-c689-4687-9969-bdb2c1c69447 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95742025-05-22T21:25:42.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77b38b3-c689-4687-9969-bdb2c1c69447 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95752025-05-22T21:25:42.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77b38b3-c689-4687-9969-bdb2c1c69447 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95762025-05-22T21:25:43.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2606e8f9-8841-4d30-9827-81c1e81813e1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95772025-05-22T21:25:43.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2606e8f9-8841-4d30-9827-81c1e81813e1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95782025-05-22T21:25:43.538ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2606e8f9-8841-4d30-9827-81c1e81813e1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95792025-05-22T21:25:44.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 060a4458-f6e4-4edb-867a-f3c6d8bbbd08 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95802025-05-22T21:25:44.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 060a4458-f6e4-4edb-867a-f3c6d8bbbd08 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95812025-05-22T21:25:44.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2316 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 060a4458-f6e4-4edb-867a-f3c6d8bbbd08 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
95822025-05-22T21:25:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
95832025-05-22T21:25:45.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
95842025-05-22T21:25:45.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95852025-05-22T21:25:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95862025-05-22T21:25:45.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95872025-05-22T21:25:45.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95882025-05-22T21:25:45.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95892025-05-22T21:25:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95902025-05-22T21:25:45.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95912025-05-22T21:25:45.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.078101ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95922025-05-22T21:25:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95932025-05-22T21:25:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95942025-05-22T21:25:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95952025-05-22T21:25:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95962025-05-22T21:25:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95972025-05-22T21:25:45.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95982025-05-22T21:25:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
95992025-05-22T21:25:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96002025-05-22T21:25:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96012025-05-22T21:25:45.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
96022025-05-22T21:25:45.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.956542ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
96032025-05-22T21:25:45.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9f7d3b6-98a3-4733-8a2c-804d88da9dea roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96042025-05-22T21:25:45.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9f7d3b6-98a3-4733-8a2c-804d88da9dea resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96052025-05-22T21:25:45.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2275 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f9f7d3b6-98a3-4733-8a2c-804d88da9dea response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96062025-05-22T21:25:46.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d93a16a-4756-4c34-9e72-5cba40abfeb3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96072025-05-22T21:25:46.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d93a16a-4756-4c34-9e72-5cba40abfeb3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96082025-05-22T21:25:46.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2605 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3d93a16a-4756-4c34-9e72-5cba40abfeb3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96092025-05-22T21:25:47.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 122ac9ff-cf7c-421a-9f92-3526cc3e1e9d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96102025-05-22T21:25:47.602ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 122ac9ff-cf7c-421a-9f92-3526cc3e1e9d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96112025-05-22T21:25:47.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 122ac9ff-cf7c-421a-9f92-3526cc3e1e9d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96122025-05-22T21:25:48.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 454 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 0acc7ce1-0b45-4221-9d3d-b42a76d5bd8e response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
96132025-05-22T21:25:48.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36d6e5e3-f50b-4c68-92f0-e49cf40b124a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96142025-05-22T21:25:48.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36d6e5e3-f50b-4c68-92f0-e49cf40b124a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96152025-05-22T21:25:48.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2466 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 36d6e5e3-f50b-4c68-92f0-e49cf40b124a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96162025-05-22T21:25:49.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 62204927-5496-4543-bb84-babedef8245b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96172025-05-22T21:25:49.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 62204927-5496-4543-bb84-babedef8245b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96182025-05-22T21:25:49.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 62204927-5496-4543-bb84-babedef8245b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96192025-05-22T21:25:50.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 194f0fe9-7a31-42df-9791-02cf346d495b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96202025-05-22T21:25:50.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 194f0fe9-7a31-42df-9791-02cf346d495b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96212025-05-22T21:25:50.650ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 194f0fe9-7a31-42df-9791-02cf346d495b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96222025-05-22T21:25:51.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5880fb4e-040c-479e-84b9-492bf19864ae roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96232025-05-22T21:25:51.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5880fb4e-040c-479e-84b9-492bf19864ae resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96242025-05-22T21:25:51.667ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5880fb4e-040c-479e-84b9-492bf19864ae response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96252025-05-22T21:25:52.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddb26420-15e5-4822-ba0d-9e6f2cc698ac roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96262025-05-22T21:25:52.681ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddb26420-15e5-4822-ba0d-9e6f2cc698ac resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96272025-05-22T21:25:52.683ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ddb26420-15e5-4822-ba0d-9e6f2cc698ac response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96282025-05-22T21:25:53.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 71e5cb75-f59c-4adb-8e5f-c6d1c6039859 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96292025-05-22T21:25:53.697ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 71e5cb75-f59c-4adb-8e5f-c6d1c6039859 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96302025-05-22T21:25:53.699ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 71e5cb75-f59c-4adb-8e5f-c6d1c6039859 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96312025-05-22T21:25:54.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7f4ca886-afc6-40d6-b40d-72b818903a34 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96322025-05-22T21:25:54.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7f4ca886-afc6-40d6-b40d-72b818903a34 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96332025-05-22T21:25:54.715ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7f4ca886-afc6-40d6-b40d-72b818903a34 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96342025-05-22T21:25:55.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
96352025-05-22T21:25:55.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
96362025-05-22T21:25:55.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96372025-05-22T21:25:55.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96382025-05-22T21:25:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96392025-05-22T21:25:55.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96402025-05-22T21:25:55.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96412025-05-22T21:25:55.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96422025-05-22T21:25:55.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96432025-05-22T21:25:55.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.925978ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96442025-05-22T21:25:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96452025-05-22T21:25:55.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96462025-05-22T21:25:55.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96472025-05-22T21:25:55.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96482025-05-22T21:25:55.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96492025-05-22T21:25:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96502025-05-22T21:25:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
96512025-05-22T21:25:55.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96522025-05-22T21:25:55.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96532025-05-22T21:25:55.111ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
96542025-05-22T21:25:55.111ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.604707ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
96552025-05-22T21:25:55.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 944c7e3d-7eda-4fca-8648-eb06dc8fc1ed roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96562025-05-22T21:25:55.729ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 944c7e3d-7eda-4fca-8648-eb06dc8fc1ed resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96572025-05-22T21:25:55.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 944c7e3d-7eda-4fca-8648-eb06dc8fc1ed response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96582025-05-22T21:25:56.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 233fd43e-aeea-48c7-b014-9d49aa6c885f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96592025-05-22T21:25:56.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 233fd43e-aeea-48c7-b014-9d49aa6c885f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96602025-05-22T21:25:56.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 233fd43e-aeea-48c7-b014-9d49aa6c885f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96612025-05-22T21:25:57.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00bbe0a0-81b9-4318-8528-93033249601a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96622025-05-22T21:25:57.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00bbe0a0-81b9-4318-8528-93033249601a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96632025-05-22T21:25:57.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 00bbe0a0-81b9-4318-8528-93033249601a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96642025-05-22T21:25:58.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 676 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 3d55367e-7b29-4e6d-8913-d4e8a3d09775 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
96652025-05-22T21:25:58.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 66e29349-2553-4ea9-bee2-3d201e3b2c04 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96662025-05-22T21:25:58.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 66e29349-2553-4ea9-bee2-3d201e3b2c04 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96672025-05-22T21:25:58.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2457 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 66e29349-2553-4ea9-bee2-3d201e3b2c04 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96682025-05-22T21:25:59.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5fdce791-9be8-4f32-887f-4216ee083750 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96692025-05-22T21:25:59.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5fdce791-9be8-4f32-887f-4216ee083750 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96702025-05-22T21:25:59.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5fdce791-9be8-4f32-887f-4216ee083750 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96712025-05-22T21:26:00.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04f2cc8f-ace4-4240-b2ee-32e4ee1cb12f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96722025-05-22T21:26:00.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04f2cc8f-ace4-4240-b2ee-32e4ee1cb12f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96732025-05-22T21:26:00.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04f2cc8f-ace4-4240-b2ee-32e4ee1cb12f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96742025-05-22T21:26:01.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c574e090-3a92-4c6a-95e2-ae8617432bc1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96752025-05-22T21:26:01.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c574e090-3a92-4c6a-95e2-ae8617432bc1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96762025-05-22T21:26:01.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c574e090-3a92-4c6a-95e2-ae8617432bc1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96772025-05-22T21:26:02.842ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b8e0e973-c74a-4d1e-8900-05fe99236e8e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96782025-05-22T21:26:02.843ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b8e0e973-c74a-4d1e-8900-05fe99236e8e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96792025-05-22T21:26:02.845ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2577 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b8e0e973-c74a-4d1e-8900-05fe99236e8e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96802025-05-22T21:26:03.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5c7c84b-78c9-4f63-80c4-dac0f889a733 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96812025-05-22T21:26:03.859ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5c7c84b-78c9-4f63-80c4-dac0f889a733 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96822025-05-22T21:26:03.861ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5c7c84b-78c9-4f63-80c4-dac0f889a733 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96832025-05-22T21:26:04.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 606ebb50-5056-4c41-855f-0bf41e66a668 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96842025-05-22T21:26:04.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 606ebb50-5056-4c41-855f-0bf41e66a668 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96852025-05-22T21:26:04.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 606ebb50-5056-4c41-855f-0bf41e66a668 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
96862025-05-22T21:26:05.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
96872025-05-22T21:26:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96882025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96892025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
96902025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96912025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96922025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
96932025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
96942025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
96952025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
96962025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
96972025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
96982025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
96992025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97002025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
97012025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97022025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
97032025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
97042025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97052025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
97062025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97072025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
97082025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97092025-05-22T21:26:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
97102025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
97112025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97122025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
97132025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
97142025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97152025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
97162025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97172025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
97182025-05-22T21:26:05.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
97192025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97202025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
97212025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97222025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
97232025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97242025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97252025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
97262025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
97272025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97282025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97292025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
97302025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97312025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97322025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97332025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97342025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97352025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97362025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
97372025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97382025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97392025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97402025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97412025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97422025-05-22T21:26:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97432025-05-22T21:26:05.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97442025-05-22T21:26:05.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.585623ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97452025-05-22T21:26:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97462025-05-22T21:26:05.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97472025-05-22T21:26:05.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97482025-05-22T21:26:05.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 238253800 } })
97492025-05-22T21:26:05.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
97502025-05-22T21:26:05.097ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512025-05-22T21:26:05.097ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97522025-05-22T21:26:05.097ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97532025-05-22T21:26:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97542025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97552025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97562025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97572025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97582025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97592025-05-22T21:26:05.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97602025-05-22T21:26:05.102ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97612025-05-22T21:26:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97622025-05-22T21:26:05.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97632025-05-22T21:26:05.103ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97642025-05-22T21:26:05.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97652025-05-22T21:26:05.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97662025-05-22T21:26:05.105ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 247807952 } })
97672025-05-22T21:26:05.105ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
97682025-05-22T21:26:05.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97692025-05-22T21:26:05.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97702025-05-22T21:26:05.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97712025-05-22T21:26:05.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97722025-05-22T21:26:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97732025-05-22T21:26:05.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97742025-05-22T21:26:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97752025-05-22T21:26:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97762025-05-22T21:26:05.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97772025-05-22T21:26:05.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97782025-05-22T21:26:05.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97792025-05-22T21:26:05.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97802025-05-22T21:26:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97812025-05-22T21:26:05.113ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97822025-05-22T21:26:05.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97832025-05-22T21:26:05.114ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97842025-05-22T21:26:05.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97852025-05-22T21:26:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97862025-05-22T21:26:05.118ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97872025-05-22T21:26:05.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97882025-05-22T21:26:05.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97892025-05-22T21:26:05.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97902025-05-22T21:26:05.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97912025-05-22T21:26:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
97922025-05-22T21:26:05.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97932025-05-22T21:26:05.123ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97942025-05-22T21:26:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97952025-05-22T21:26:05.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97962025-05-22T21:26:05.126ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97972025-05-22T21:26:05.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97982025-05-22T21:26:05.129ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97992025-05-22T21:26:05.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98002025-05-22T21:26:05.150ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.859755ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
98012025-05-22T21:26:05.150ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 64.605742ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
98022025-05-22T21:26:05.151ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
98032025-05-22T21:26:05.151ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.118204ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
98042025-05-22T21:26:05.154ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.689178ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
98052025-05-22T21:26:05.155ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
98062025-05-22T21:26:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
98072025-05-22T21:26:05.156ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98082025-05-22T21:26:05.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 70.832284ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98092025-05-22T21:26:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
98102025-05-22T21:26:05.158ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98112025-05-22T21:26:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98122025-05-22T21:26:05.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98132025-05-22T21:26:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98142025-05-22T21:26:05.164ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98152025-05-22T21:26:05.164ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
98162025-05-22T21:26:05.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98172025-05-22T21:26:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98182025-05-22T21:26:05.164ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1474, tv_nsec: 307107825 } })
98192025-05-22T21:26:05.164ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
98202025-05-22T21:26:05.166ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98212025-05-22T21:26:05.166ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98222025-05-22T21:26:05.166ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
98232025-05-22T21:26:05.166ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
98242025-05-22T21:26:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
98252025-05-22T21:26:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98262025-05-22T21:26:05.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
98272025-05-22T21:26:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
98282025-05-22T21:26:05.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98292025-05-22T21:26:05.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
98302025-05-22T21:26:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
98312025-05-22T21:26:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
98322025-05-22T21:26:05.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98332025-05-22T21:26:05.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98342025-05-22T21:26:05.174ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 87.9789ms iteration = 18 status = 0
98352025-05-22T21:26:05.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.777816ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98362025-05-22T21:26:05.184ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98372025-05-22T21:26:05.184ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.741244ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98382025-05-22T21:26:05.191ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
98392025-05-22T21:26:05.191ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98402025-05-22T21:26:05.191ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "724b0c30-3211-4a3f-a138-79dfdc04c5b3", "content-length": "26", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98412025-05-22T21:26:05.191ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98422025-05-22T21:26:05.194ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98432025-05-22T21:26:05.196ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98442025-05-22T21:26:05.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98452025-05-22T21:26:05.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98462025-05-22T21:26:05.198ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98472025-05-22T21:26:05.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98482025-05-22T21:26:05.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98492025-05-22T21:26:05.199ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98502025-05-22T21:26:05.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98512025-05-22T21:26:05.201ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98522025-05-22T21:26:05.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98532025-05-22T21:26:05.203ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98542025-05-22T21:26:05.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98552025-05-22T21:26:05.207ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
98562025-05-22T21:26:05.207ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 120.176888ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
98572025-05-22T21:26:05.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.135681ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
98582025-05-22T21:26:05.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.005619ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
98592025-05-22T21:26:05.221ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98602025-05-22T21:26:05.221ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98612025-05-22T21:26:05.221ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 135.042228ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98622025-05-22T21:26:05.227ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
98632025-05-22T21:26:05.227ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98642025-05-22T21:26:05.227ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "49ebfa3c-0416-4b5c-ae4b-39892a040732", "content-length": "26", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98652025-05-22T21:26:05.227ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98662025-05-22T21:26:05.230ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98672025-05-22T21:26:05.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
98682025-05-22T21:26:05.303ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98692025-05-22T21:26:05.304ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a4ec30cc-93b8-49e8-a1f3-b1531e6f4888", "content-length": "26", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98702025-05-22T21:26:05.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98712025-05-22T21:26:05.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
98722025-05-22T21:26:05.330ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 244.020771ms iteration = 20 status = {"physical_disks_added":0}
98732025-05-22T21:26:05.360ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98742025-05-22T21:26:05.360ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98752025-05-22T21:26:05.361ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55ff16aa-a2d6-44db-bd44-4d3fa69ed1f6", "content-length": "372", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98762025-05-22T21:26:05.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98772025-05-22T21:26:05.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98782025-05-22T21:26:05.376ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98792025-05-22T21:26:05.376ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98802025-05-22T21:26:05.376ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "54ec1c0e-8525-4ec0-9a37-234bb60aab1e", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98812025-05-22T21:26:05.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98822025-05-22T21:26:05.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98832025-05-22T21:26:05.385ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 299.271133ms iteration = 18 status = {}
98842025-05-22T21:26:05.399ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98852025-05-22T21:26:05.399ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a267c1a-cc00-4a73-8276-a91ea9cd6018", "content-length": "691", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
98862025-05-22T21:26:05.399ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
98872025-05-22T21:26:05.399ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
98882025-05-22T21:26:05.399ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
98892025-05-22T21:26:05.401ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 314.389857ms iteration = 18 status = {}
98902025-05-22T21:26:05.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98912025-05-22T21:26:05.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98922025-05-22T21:26:05.404ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98932025-05-22T21:26:05.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98942025-05-22T21:26:05.404ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98952025-05-22T21:26:05.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98962025-05-22T21:26:05.406ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.842229ms iteration = 18 status = null
98972025-05-22T21:26:05.406ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98982025-05-22T21:26:05.406ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98992025-05-22T21:26:05.407ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "86d7e75e-2b54-4e0c-a0e2-a1cbb9665091", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
99002025-05-22T21:26:05.408ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 321.864319ms iteration = 18 status = {}
99012025-05-22T21:26:05.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99022025-05-22T21:26:05.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99032025-05-22T21:26:05.463ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
99042025-05-22T21:26:05.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99052025-05-22T21:26:05.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99062025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99072025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
99082025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99092025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99102025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99112025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99122025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99132025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99142025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99152025-05-22T21:26:05.475ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99162025-05-22T21:26:05.476ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
99172025-05-22T21:26:05.476ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99182025-05-22T21:26:05.476ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99192025-05-22T21:26:05.478ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
99202025-05-22T21:26:05.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99212025-05-22T21:26:05.621ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c7a37ceb-5367-4935-8a18-8bb5cffed5c4", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
99222025-05-22T21:26:05.621ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
99232025-05-22T21:26:05.621ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99242025-05-22T21:26:05.622ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f80f02f0-6c0f-4f6b-8015-7c0d7860507a", "content-length": "682", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
99252025-05-22T21:26:05.622ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99262025-05-22T21:26:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99272025-05-22T21:26:05.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99282025-05-22T21:26:05.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99292025-05-22T21:26:05.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99302025-05-22T21:26:05.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99312025-05-22T21:26:05.635ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99322025-05-22T21:26:05.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99332025-05-22T21:26:05.642ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 555.512746ms iteration = 18 status = {}
99342025-05-22T21:26:05.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32d76e97-5332-4eec-aed1-d9c198ca7691 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99352025-05-22T21:26:05.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32d76e97-5332-4eec-aed1-d9c198ca7691 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99362025-05-22T21:26:05.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32d76e97-5332-4eec-aed1-d9c198ca7691 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99372025-05-22T21:26:05.914ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 3
99382025-05-22T21:26:05.914ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
99392025-05-22T21:26:05.944ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
99402025-05-22T21:26:05.944ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:60170
99412025-05-22T21:26:05.944ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60170 req_id = 5a6cad44-ed78-4d44-8691-568e16f1d635 roles = RoleSet { roles: {} } uri = /metrics/producers
99422025-05-22T21:26:05.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60170 req_id = 5a6cad44-ed78-4d44-8691-568e16f1d635 resource = Database result = Ok(()) uri = /metrics/producers
99432025-05-22T21:26:05.990ZINFOnexus: assigned collector to new producer collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 file = nexus/src/app/oximeter.rs:76 producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
99442025-05-22T21:26:05.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 45922 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:60170 req_id = 5a6cad44-ed78-4d44-8691-568e16f1d635 response_code = 201 uri = /metrics/producers
99452025-05-22T21:26:05.990ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "5a6cad44-ed78-4d44-8691-568e16f1d635", "content-length": "41", "date": "Thu, 22 May 2025 21:26:05 GMT"} })
99462025-05-22T21:26:05.991ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
99472025-05-22T21:26:06.906ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 27f50253-d04e-4ca5-9031-664467bd3511 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99482025-05-22T21:26:06.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 27f50253-d04e-4ca5-9031-664467bd3511 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99492025-05-22T21:26:06.908ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 27f50253-d04e-4ca5-9031-664467bd3511 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99502025-05-22T21:26:07.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0181c890-940b-482c-9da2-bab9ab1d0a3a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99512025-05-22T21:26:07.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0181c890-940b-482c-9da2-bab9ab1d0a3a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99522025-05-22T21:26:07.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0181c890-940b-482c-9da2-bab9ab1d0a3a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99532025-05-22T21:26:08.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 649 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 7992e931-c8ee-4498-b681-6730d7af427a response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
99542025-05-22T21:26:08.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5fa9aa2-2269-43bb-bb68-d57119037e24 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99552025-05-22T21:26:08.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5fa9aa2-2269-43bb-bb68-d57119037e24 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99562025-05-22T21:26:08.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5fa9aa2-2269-43bb-bb68-d57119037e24 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99572025-05-22T21:26:09.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 904de7e9-6d67-447e-ace9-8624d334071e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99582025-05-22T21:26:09.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 904de7e9-6d67-447e-ace9-8624d334071e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99592025-05-22T21:26:09.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 904de7e9-6d67-447e-ace9-8624d334071e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99602025-05-22T21:26:10.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e45ba249-f33a-4651-9e63-4a00e565df96 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99612025-05-22T21:26:10.971ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e45ba249-f33a-4651-9e63-4a00e565df96 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99622025-05-22T21:26:10.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e45ba249-f33a-4651-9e63-4a00e565df96 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99632025-05-22T21:26:11.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86aa0c62-41b1-4222-995c-52295156f56e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99642025-05-22T21:26:11.988ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86aa0c62-41b1-4222-995c-52295156f56e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99652025-05-22T21:26:11.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86aa0c62-41b1-4222-995c-52295156f56e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99662025-05-22T21:26:13.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436b93ed-69a2-48fe-b3ca-adfea9215d1a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99672025-05-22T21:26:13.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436b93ed-69a2-48fe-b3ca-adfea9215d1a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99682025-05-22T21:26:13.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 436b93ed-69a2-48fe-b3ca-adfea9215d1a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99692025-05-22T21:26:14.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72795068-18cc-4cc1-8e07-bc256b39c264 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99702025-05-22T21:26:14.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72795068-18cc-4cc1-8e07-bc256b39c264 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99712025-05-22T21:26:14.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72795068-18cc-4cc1-8e07-bc256b39c264 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99722025-05-22T21:26:15.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 287b7842-31f2-49b1-9142-425fee1d07b2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99732025-05-22T21:26:15.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 287b7842-31f2-49b1-9142-425fee1d07b2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99742025-05-22T21:26:15.051ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 287b7842-31f2-49b1-9142-425fee1d07b2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99752025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
99762025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
99772025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99782025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99792025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99802025-05-22T21:26:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99812025-05-22T21:26:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99822025-05-22T21:26:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99832025-05-22T21:26:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99842025-05-22T21:26:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99852025-05-22T21:26:15.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99862025-05-22T21:26:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99872025-05-22T21:26:15.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99882025-05-22T21:26:15.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99892025-05-22T21:26:15.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99902025-05-22T21:26:15.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
99912025-05-22T21:26:15.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99922025-05-22T21:26:15.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99932025-05-22T21:26:15.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
99942025-05-22T21:26:15.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.488449ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
99952025-05-22T21:26:15.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.607869ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99962025-05-22T21:26:16.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fa7bd509-5442-4640-b9f2-ef4dcce61207 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99972025-05-22T21:26:16.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fa7bd509-5442-4640-b9f2-ef4dcce61207 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99982025-05-22T21:26:16.067ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fa7bd509-5442-4640-b9f2-ef4dcce61207 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
99992025-05-22T21:26:17.080ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a95e05e-ee61-4588-b0e2-0df4e0a98dd5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100002025-05-22T21:26:17.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a95e05e-ee61-4588-b0e2-0df4e0a98dd5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100012025-05-22T21:26:17.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a95e05e-ee61-4588-b0e2-0df4e0a98dd5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100022025-05-22T21:26:18.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d750d597-6dde-4826-95ff-d1dca3b0d09c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100032025-05-22T21:26:18.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d750d597-6dde-4826-95ff-d1dca3b0d09c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100042025-05-22T21:26:18.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2233 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d750d597-6dde-4826-95ff-d1dca3b0d09c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100052025-05-22T21:26:18.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:39537
100062025-05-22T21:26:18.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 3c5920af-b5a2-429d-b168-5a3575df4fdd roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
100072025-05-22T21:26:18.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 3c5920af-b5a2-429d-b168-5a3575df4fdd resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
100082025-05-22T21:26:18.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 3c5920af-b5a2-429d-b168-5a3575df4fdd response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
100092025-05-22T21:26:18.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 484c27b6-d7d3-4389-bad8-bde2ec5f072f roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
100102025-05-22T21:26:18.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 484c27b6-d7d3-4389-bad8-bde2ec5f072f resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
100112025-05-22T21:26:18.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 484c27b6-d7d3-4389-bad8-bde2ec5f072f response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
100122025-05-22T21:26:18.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 408 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = bb09a64a-0401-4ac2-beea-64685d191568 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
100132025-05-22T21:26:19.112ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd2989d0-f53c-4a92-8dfe-8f054bde83ab roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100142025-05-22T21:26:19.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd2989d0-f53c-4a92-8dfe-8f054bde83ab resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100152025-05-22T21:26:19.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2596 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd2989d0-f53c-4a92-8dfe-8f054bde83ab response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100162025-05-22T21:26:20.128ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2842c011-89fd-45d5-8af2-c0c473877427 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100172025-05-22T21:26:20.128ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2842c011-89fd-45d5-8af2-c0c473877427 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100182025-05-22T21:26:20.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2842c011-89fd-45d5-8af2-c0c473877427 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100192025-05-22T21:26:21.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cc8cf7c-ed90-4b7a-8ed1-ddd92363f001 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100202025-05-22T21:26:21.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cc8cf7c-ed90-4b7a-8ed1-ddd92363f001 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100212025-05-22T21:26:21.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1cc8cf7c-ed90-4b7a-8ed1-ddd92363f001 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100222025-05-22T21:26:22.158ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f2676ce9-242b-4477-bebd-3184dfcc5418 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100232025-05-22T21:26:22.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f2676ce9-242b-4477-bebd-3184dfcc5418 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100242025-05-22T21:26:22.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f2676ce9-242b-4477-bebd-3184dfcc5418 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100252025-05-22T21:26:23.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 20f0c65e-e912-4fad-b40b-085bbdd7b30f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100262025-05-22T21:26:23.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 20f0c65e-e912-4fad-b40b-085bbdd7b30f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100272025-05-22T21:26:23.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 20f0c65e-e912-4fad-b40b-085bbdd7b30f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100282025-05-22T21:26:24.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc3c253-f149-45eb-99cc-e49b6bc5b6be roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100292025-05-22T21:26:24.189ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc3c253-f149-45eb-99cc-e49b6bc5b6be resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100302025-05-22T21:26:24.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2309 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc3c253-f149-45eb-99cc-e49b6bc5b6be response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100312025-05-22T21:26:25.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
100322025-05-22T21:26:25.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100332025-05-22T21:26:25.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
100342025-05-22T21:26:25.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100352025-05-22T21:26:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100362025-05-22T21:26:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100372025-05-22T21:26:25.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100382025-05-22T21:26:25.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100392025-05-22T21:26:25.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100402025-05-22T21:26:25.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.966329ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100412025-05-22T21:26:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100422025-05-22T21:26:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100432025-05-22T21:26:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100442025-05-22T21:26:25.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100452025-05-22T21:26:25.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100462025-05-22T21:26:25.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100472025-05-22T21:26:25.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
100482025-05-22T21:26:25.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100492025-05-22T21:26:25.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100502025-05-22T21:26:25.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
100512025-05-22T21:26:25.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.921197ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
100522025-05-22T21:26:25.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed6e7dca-c59a-44e7-babc-a8e22cbc9eee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100532025-05-22T21:26:25.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed6e7dca-c59a-44e7-babc-a8e22cbc9eee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100542025-05-22T21:26:25.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2035 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ed6e7dca-c59a-44e7-babc-a8e22cbc9eee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100552025-05-22T21:26:26.222ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4df4d2b-4529-4472-b7d6-9108788b52b5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100562025-05-22T21:26:26.222ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4df4d2b-4529-4472-b7d6-9108788b52b5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100572025-05-22T21:26:26.224ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a4df4d2b-4529-4472-b7d6-9108788b52b5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100582025-05-22T21:26:27.238ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae5c992d-1d81-4802-8a98-e6fc97c16b82 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100592025-05-22T21:26:27.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae5c992d-1d81-4802-8a98-e6fc97c16b82 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100602025-05-22T21:26:27.240ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1864 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae5c992d-1d81-4802-8a98-e6fc97c16b82 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100612025-05-22T21:26:28.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 455 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = a8bd5682-9093-43de-bc28-cc7a484d2a64 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
100622025-05-22T21:26:28.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53e7e82d-cb90-43bf-b662-42b0dcae76fb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100632025-05-22T21:26:28.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53e7e82d-cb90-43bf-b662-42b0dcae76fb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100642025-05-22T21:26:28.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2198 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53e7e82d-cb90-43bf-b662-42b0dcae76fb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100652025-05-22T21:26:29.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68ee945f-cd87-40d4-9ac0-fa505316015e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100662025-05-22T21:26:29.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68ee945f-cd87-40d4-9ac0-fa505316015e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100672025-05-22T21:26:29.272ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2135 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68ee945f-cd87-40d4-9ac0-fa505316015e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100682025-05-22T21:26:30.285ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bca0f8bf-4bfb-42f4-a4c7-341330d47b99 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100692025-05-22T21:26:30.285ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bca0f8bf-4bfb-42f4-a4c7-341330d47b99 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100702025-05-22T21:26:30.287ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bca0f8bf-4bfb-42f4-a4c7-341330d47b99 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100712025-05-22T21:26:31.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb05ca43-b450-4552-a6cf-b4a93081cf44 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100722025-05-22T21:26:31.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb05ca43-b450-4552-a6cf-b4a93081cf44 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100732025-05-22T21:26:31.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb05ca43-b450-4552-a6cf-b4a93081cf44 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100742025-05-22T21:26:32.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7d0eab7-0c0a-41b7-9f59-ae2bf655ca23 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100752025-05-22T21:26:32.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7d0eab7-0c0a-41b7-9f59-ae2bf655ca23 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100762025-05-22T21:26:32.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2015 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e7d0eab7-0c0a-41b7-9f59-ae2bf655ca23 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100772025-05-22T21:26:33.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f23645a-6723-4bf3-9b8b-275e65993e5b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100782025-05-22T21:26:33.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f23645a-6723-4bf3-9b8b-275e65993e5b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100792025-05-22T21:26:33.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f23645a-6723-4bf3-9b8b-275e65993e5b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100802025-05-22T21:26:34.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 699b8fda-8ce9-466b-b951-6b73f58d795f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100812025-05-22T21:26:34.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 699b8fda-8ce9-466b-b951-6b73f58d795f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100822025-05-22T21:26:34.351ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2236 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 699b8fda-8ce9-466b-b951-6b73f58d795f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
100832025-05-22T21:26:35.084ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
100842025-05-22T21:26:35.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100852025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
100862025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
100872025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100882025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100892025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
100902025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100912025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
100922025-05-22T21:26:35.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100932025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
100942025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100952025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
100962025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100972025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100982025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
100992025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101002025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
101012025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101022025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
101032025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101042025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
101052025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101062025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
101072025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
101082025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
101092025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
101102025-05-22T21:26:35.085ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
101112025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
101122025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.63\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
101132025-05-22T21:26:35.085ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:16:35.085195135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
101142025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
101152025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
101162025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
101172025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101182025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
101192025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101202025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
101212025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101222025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
101232025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
101242025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
101252025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
101262025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101272025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
101282025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101292025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
101302025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
101312025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 10 reason = Timeout
101322025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
101332025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
101342025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
101352025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
101362025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101372025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
101382025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101392025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
101402025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
101412025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
101422025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
101432025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101442025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
101452025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
101462025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101472025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
101482025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
101492025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
101502025-05-22T21:26:35.085ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
101512025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101522025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101532025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
101542025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
101552025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
101562025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101572025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101582025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101592025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101602025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101612025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101622025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101632025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
101642025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101652025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
101662025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
101672025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101682025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101692025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101702025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101712025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
101722025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101732025-05-22T21:26:35.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
101742025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
101752025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101762025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
101772025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
101782025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101792025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101802025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
101812025-05-22T21:26:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 228969651 } })
101822025-05-22T21:26:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 228979151 } })
101832025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101842025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101852025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101862025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101872025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101882025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
101892025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101902025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101912025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.465112ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
101922025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
101932025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.557694ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
101942025-05-22T21:26:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101952025-05-22T21:26:35.087ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 10 reason = Timeout
101962025-05-22T21:26:35.087ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
101972025-05-22T21:26:35.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101982025-05-22T21:26:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
101992025-05-22T21:26:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.01634ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
102002025-05-22T21:26:35.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102012025-05-22T21:26:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102022025-05-22T21:26:35.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102032025-05-22T21:26:35.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102042025-05-22T21:26:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 6.012259ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
102052025-05-22T21:26:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
102062025-05-22T21:26:35.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102072025-05-22T21:26:35.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102082025-05-22T21:26:35.095ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 237919794 } })
102092025-05-22T21:26:35.095ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
102102025-05-22T21:26:35.100ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102112025-05-22T21:26:35.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102122025-05-22T21:26:35.101ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102132025-05-22T21:26:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
102142025-05-22T21:26:35.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102152025-05-22T21:26:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102162025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
102172025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102182025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102192025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102202025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102212025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102222025-05-22T21:26:35.105ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:16:35.085195135 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
102232025-05-22T21:26:35.105ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 20.297572ms iteration = 10 status = {"expiration":"2025-05-22T21:16:35.085195135Z","pruned":[]}
102242025-05-22T21:26:35.112ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
102252025-05-22T21:26:35.112ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
102262025-05-22T21:26:35.112ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 27.205765ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
102272025-05-22T21:26:35.112ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.276086ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
102282025-05-22T21:26:35.113ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102292025-05-22T21:26:35.113ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102302025-05-22T21:26:35.114ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102312025-05-22T21:26:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102322025-05-22T21:26:35.116ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102332025-05-22T21:26:35.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 260566261 } })
102342025-05-22T21:26:35.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102352025-05-22T21:26:35.117ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102362025-05-22T21:26:35.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
102372025-05-22T21:26:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102382025-05-22T21:26:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102392025-05-22T21:26:35.118ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102402025-05-22T21:26:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102412025-05-22T21:26:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
102422025-05-22T21:26:35.120ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
102432025-05-22T21:26:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
102442025-05-22T21:26:35.121ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
102452025-05-22T21:26:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102462025-05-22T21:26:35.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102472025-05-22T21:26:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102482025-05-22T21:26:35.122ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102492025-05-22T21:26:35.122ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
102502025-05-22T21:26:35.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102512025-05-22T21:26:35.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102522025-05-22T21:26:35.122ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102532025-05-22T21:26:35.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102542025-05-22T21:26:35.124ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102552025-05-22T21:26:35.127ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102562025-05-22T21:26:35.128ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 43.231723ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
102572025-05-22T21:26:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
102582025-05-22T21:26:35.130ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
102592025-05-22T21:26:35.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
102602025-05-22T21:26:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102612025-05-22T21:26:35.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102622025-05-22T21:26:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102632025-05-22T21:26:35.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102642025-05-22T21:26:35.134ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
102652025-05-22T21:26:35.134ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 47.121751ms iteration = 10 status = {"by_rx":{},"error":null}
102662025-05-22T21:26:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102672025-05-22T21:26:35.136ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102682025-05-22T21:26:35.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102692025-05-22T21:26:35.136ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102702025-05-22T21:26:35.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102712025-05-22T21:26:35.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102722025-05-22T21:26:35.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102732025-05-22T21:26:35.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102742025-05-22T21:26:35.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102752025-05-22T21:26:35.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102762025-05-22T21:26:35.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102772025-05-22T21:26:35.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102782025-05-22T21:26:35.140ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
102792025-05-22T21:26:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
102802025-05-22T21:26:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
102812025-05-22T21:26:35.142ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
102822025-05-22T21:26:35.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
102832025-05-22T21:26:35.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102842025-05-22T21:26:35.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1504, tv_nsec: 288830642 } })
102852025-05-22T21:26:35.146ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
102862025-05-22T21:26:35.146ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102872025-05-22T21:26:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102882025-05-22T21:26:35.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
102892025-05-22T21:26:35.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102902025-05-22T21:26:35.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102912025-05-22T21:26:35.149ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
102922025-05-22T21:26:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
102932025-05-22T21:26:35.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102942025-05-22T21:26:35.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102952025-05-22T21:26:35.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102962025-05-22T21:26:35.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102972025-05-22T21:26:35.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.186183ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102982025-05-22T21:26:35.171ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
102992025-05-22T21:26:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103002025-05-22T21:26:35.173ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 88.537578ms iteration = 5 status = {"nsuccess":5}
103012025-05-22T21:26:35.176ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103022025-05-22T21:26:35.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103032025-05-22T21:26:35.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103042025-05-22T21:26:35.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103052025-05-22T21:26:35.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
103062025-05-22T21:26:35.181ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103072025-05-22T21:26:35.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103082025-05-22T21:26:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
103092025-05-22T21:26:35.182ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103102025-05-22T21:26:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103112025-05-22T21:26:35.182ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 97.012303ms iteration = 10 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
103122025-05-22T21:26:35.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.12587ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
103132025-05-22T21:26:35.191ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103142025-05-22T21:26:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103152025-05-22T21:26:35.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103162025-05-22T21:26:35.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103172025-05-22T21:26:35.204ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103182025-05-22T21:26:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103192025-05-22T21:26:35.206ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103202025-05-22T21:26:35.210ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
103212025-05-22T21:26:35.210ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
103222025-05-22T21:26:35.210ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.840062ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
103232025-05-22T21:26:35.213ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
103242025-05-22T21:26:35.213ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 128.597883ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
103252025-05-22T21:26:35.222ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
103262025-05-22T21:26:35.222ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
103272025-05-22T21:26:35.222ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
103282025-05-22T21:26:35.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103292025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
103302025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
103312025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
103322025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103332025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103342025-05-22T21:26:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103352025-05-22T21:26:35.225ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103362025-05-22T21:26:35.227ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
103372025-05-22T21:26:35.227ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
103382025-05-22T21:26:35.227ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103392025-05-22T21:26:35.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103402025-05-22T21:26:35.228ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
103412025-05-22T21:26:35.228ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103422025-05-22T21:26:35.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103432025-05-22T21:26:35.229ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103442025-05-22T21:26:35.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
103452025-05-22T21:26:35.260ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
103462025-05-22T21:26:35.260ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103472025-05-22T21:26:35.260ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "768ae98b-6ae0-47c7-a879-afef0c045077", "content-length": "26", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
103482025-05-22T21:26:35.260ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103492025-05-22T21:26:35.262ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103502025-05-22T21:26:35.293ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
103512025-05-22T21:26:35.301ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103522025-05-22T21:26:35.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103532025-05-22T21:26:35.332ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
103542025-05-22T21:26:35.332ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 247.210198ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103552025-05-22T21:26:35.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86d72fd2-2ef4-43d2-bf68-68ea0c53c3c9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
103562025-05-22T21:26:35.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86d72fd2-2ef4-43d2-bf68-68ea0c53c3c9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
103572025-05-22T21:26:35.374ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
103582025-05-22T21:26:35.375ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103592025-05-22T21:26:35.375ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad79234e-7a27-4178-80be-3ecc1bc78782", "content-length": "26", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
103602025-05-22T21:26:35.375ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103612025-05-22T21:26:35.377ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
103622025-05-22T21:26:35.402ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103632025-05-22T21:26:35.402ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103642025-05-22T21:26:35.403ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "557c1b0f-ad94-4111-b715-9a77746eb987", "content-length": "372", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
103652025-05-22T21:26:35.403ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103662025-05-22T21:26:35.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103672025-05-22T21:26:35.404ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
103682025-05-22T21:26:35.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "eb6047c3-47de-4e02-a553-fff5c9df1b69", "date": "Thu, 22 May 2025 21:26:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103692025-05-22T21:26:35.404ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103702025-05-22T21:26:35.405ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "074ec03b-ad76-4545-9f6b-2f6f3ce8cad5", "date": "Thu, 22 May 2025 21:26:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103712025-05-22T21:26:35.405ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103722025-05-22T21:26:35.405ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103732025-05-22T21:26:35.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103742025-05-22T21:26:35.407ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103752025-05-22T21:26:35.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103762025-05-22T21:26:35.407ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
103772025-05-22T21:26:35.407ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 322.373607ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103782025-05-22T21:26:35.408ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103792025-05-22T21:26:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
103802025-05-22T21:26:35.412ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103812025-05-22T21:26:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103822025-05-22T21:26:35.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103832025-05-22T21:26:35.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 50543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 86d72fd2-2ef4-43d2-bf68-68ea0c53c3c9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
103842025-05-22T21:26:35.422ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
103852025-05-22T21:26:35.422ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103862025-05-22T21:26:35.422ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc221a8f-4c6b-4bc7-bdc0-20f782fc262d", "content-length": "26", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
103872025-05-22T21:26:35.422ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103882025-05-22T21:26:35.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103892025-05-22T21:26:35.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103902025-05-22T21:26:35.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103912025-05-22T21:26:35.425ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103922025-05-22T21:26:35.425ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
103932025-05-22T21:26:35.425ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 340.821751ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
103942025-05-22T21:26:35.457ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103952025-05-22T21:26:35.460ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 375.202013ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
103962025-05-22T21:26:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
103972025-05-22T21:26:35.461ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
103982025-05-22T21:26:35.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
103992025-05-22T21:26:35.462ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104002025-05-22T21:26:35.462ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
104012025-05-22T21:26:35.462ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 377.659939ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
104022025-05-22T21:26:35.463ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 378.446661ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104032025-05-22T21:26:35.463ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104042025-05-22T21:26:35.464ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104052025-05-22T21:26:35.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104062025-05-22T21:26:35.464ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104072025-05-22T21:26:35.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104082025-05-22T21:26:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104092025-05-22T21:26:35.467ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104102025-05-22T21:26:35.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104112025-05-22T21:26:35.468ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104122025-05-22T21:26:35.468ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104132025-05-22T21:26:35.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104142025-05-22T21:26:35.470ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104152025-05-22T21:26:35.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104162025-05-22T21:26:35.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104172025-05-22T21:26:35.471ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 386.248347ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
104182025-05-22T21:26:35.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104192025-05-22T21:26:35.477ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
104202025-05-22T21:26:35.477ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104212025-05-22T21:26:35.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104222025-05-22T21:26:35.480ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104232025-05-22T21:26:35.481ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
104242025-05-22T21:26:35.481ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
104252025-05-22T21:26:35.481ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104262025-05-22T21:26:35.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104272025-05-22T21:26:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
104282025-05-22T21:26:35.484ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104292025-05-22T21:26:35.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104302025-05-22T21:26:35.484ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
104312025-05-22T21:26:35.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104322025-05-22T21:26:35.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104332025-05-22T21:26:35.487ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 402.53875ms iteration = 19 status = 0
104342025-05-22T21:26:35.489ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 404.189034ms iteration = 19 status = null
104352025-05-22T21:26:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104362025-05-22T21:26:35.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104372025-05-22T21:26:35.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104382025-05-22T21:26:35.496ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
104392025-05-22T21:26:35.496ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
104402025-05-22T21:26:35.496ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
104412025-05-22T21:26:35.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 410.948415ms iteration = 10 status = {"generation":1}
104422025-05-22T21:26:35.499ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
104432025-05-22T21:26:35.499ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
104442025-05-22T21:26:35.499ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "bb609988-c469-43cf-896d-962b4161479f", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
104452025-05-22T21:26:35.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104462025-05-22T21:26:35.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104472025-05-22T21:26:35.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104482025-05-22T21:26:35.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104492025-05-22T21:26:35.502ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
104502025-05-22T21:26:35.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104512025-05-22T21:26:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104522025-05-22T21:26:35.510ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
104532025-05-22T21:26:35.510ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
104542025-05-22T21:26:35.510ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "87782489-2c24-45a5-9baf-f421ac1aa36d", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
104552025-05-22T21:26:35.512ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 427.909787ms iteration = 19 status = {}
104562025-05-22T21:26:35.512ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
104572025-05-22T21:26:35.513ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 427.890316ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
104582025-05-22T21:26:35.517ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
104592025-05-22T21:26:35.517ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
104602025-05-22T21:26:35.517ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104612025-05-22T21:26:35.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104622025-05-22T21:26:35.519ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
104632025-05-22T21:26:35.519ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 434.043929ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
104642025-05-22T21:26:35.519ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104652025-05-22T21:26:35.523ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104662025-05-22T21:26:35.523ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104672025-05-22T21:26:35.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104682025-05-22T21:26:35.525ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
104692025-05-22T21:26:35.525ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
104702025-05-22T21:26:35.525ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
104712025-05-22T21:26:35.525ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 440.376363ms iteration = 10 status = {"generation":2}
104722025-05-22T21:26:35.526ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 440.906761ms iteration = 19 status = {}
104732025-05-22T21:26:35.593ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
104742025-05-22T21:26:35.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7199da53-9f55-40f2-a697-25da4b2a0616", "date": "Thu, 22 May 2025 21:26:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104752025-05-22T21:26:35.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104762025-05-22T21:26:35.597ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ab3cc99c-45e6-4b83-86c4-912254117468", "date": "Thu, 22 May 2025 21:26:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104772025-05-22T21:26:35.597ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104782025-05-22T21:26:35.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba63a98f-8c98-4853-b9f4-73eef896bd57", "date": "Thu, 22 May 2025 21:26:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104792025-05-22T21:26:35.600ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104802025-05-22T21:26:35.602ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
104812025-05-22T21:26:35.602ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 517.330608ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
104822025-05-22T21:26:35.617ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 531.896595ms iteration = 21 status = {"physical_disks_added":0}
104832025-05-22T21:26:35.672ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
104842025-05-22T21:26:35.672ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a733d82-58de-48c7-beba-75c668d0e931", "content-length": "691", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
104852025-05-22T21:26:35.672ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
104862025-05-22T21:26:35.672ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
104872025-05-22T21:26:35.672ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
104882025-05-22T21:26:35.674ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 589.537502ms iteration = 19 status = {}
104892025-05-22T21:26:35.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104902025-05-22T21:26:35.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104912025-05-22T21:26:35.679ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
104922025-05-22T21:26:35.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104932025-05-22T21:26:35.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104942025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
104952025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
104962025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
104972025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
104982025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
104992025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105002025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105012025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105022025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
105032025-05-22T21:26:35.692ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
105042025-05-22T21:26:35.693ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
105052025-05-22T21:26:35.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105062025-05-22T21:26:35.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105072025-05-22T21:26:35.696ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
105082025-05-22T21:26:35.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
105092025-05-22T21:26:35.809ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "28c29cc5-ad4d-4f8e-912a-0c4ce444233a", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
105102025-05-22T21:26:35.809ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
105112025-05-22T21:26:35.809ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
105122025-05-22T21:26:35.810ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d96865f1-34c2-4319-a725-c6a8d04b341c", "content-length": "682", "date": "Thu, 22 May 2025 21:26:35 GMT"} })
105132025-05-22T21:26:35.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105142025-05-22T21:26:35.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105152025-05-22T21:26:35.814ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105162025-05-22T21:26:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105172025-05-22T21:26:35.818ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105182025-05-22T21:26:35.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105192025-05-22T21:26:35.821ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105202025-05-22T21:26:35.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105212025-05-22T21:26:35.828ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 743.528384ms iteration = 19 status = {}
105222025-05-22T21:26:36.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f7ead69-b819-4e42-8de2-b3674ff135f6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105232025-05-22T21:26:36.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f7ead69-b819-4e42-8de2-b3674ff135f6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105242025-05-22T21:26:36.444ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2583 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f7ead69-b819-4e42-8de2-b3674ff135f6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105252025-05-22T21:26:37.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4730a88e-09bf-4787-a51e-474a678f820b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105262025-05-22T21:26:37.457ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4730a88e-09bf-4787-a51e-474a678f820b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105272025-05-22T21:26:37.459ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4730a88e-09bf-4787-a51e-474a678f820b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105282025-05-22T21:26:38.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 623 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 978c961f-3f12-49ab-8d37-64eed1b32464 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
105292025-05-22T21:26:38.473ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a582f07-b3ec-4324-9a93-1a52d837fd61 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105302025-05-22T21:26:38.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a582f07-b3ec-4324-9a93-1a52d837fd61 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105312025-05-22T21:26:38.476ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4a582f07-b3ec-4324-9a93-1a52d837fd61 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105322025-05-22T21:26:39.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0de12a5c-b8bf-4c88-8fa5-0d5227a3ae94 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105332025-05-22T21:26:39.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0de12a5c-b8bf-4c88-8fa5-0d5227a3ae94 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105342025-05-22T21:26:39.492ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0de12a5c-b8bf-4c88-8fa5-0d5227a3ae94 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105352025-05-22T21:26:40.507ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 546a5564-c91b-42fa-9982-5c4d97985e94 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105362025-05-22T21:26:40.507ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 546a5564-c91b-42fa-9982-5c4d97985e94 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105372025-05-22T21:26:40.509ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2306 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 546a5564-c91b-42fa-9982-5c4d97985e94 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105382025-05-22T21:26:41.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38fdbd44-ed2b-4e99-a637-ac7d93e1c759 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105392025-05-22T21:26:41.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38fdbd44-ed2b-4e99-a637-ac7d93e1c759 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105402025-05-22T21:26:41.526ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38fdbd44-ed2b-4e99-a637-ac7d93e1c759 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105412025-05-22T21:26:42.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fea0ec05-36df-4148-9f12-7a8f516ad237 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105422025-05-22T21:26:42.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fea0ec05-36df-4148-9f12-7a8f516ad237 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105432025-05-22T21:26:42.542ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2252 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fea0ec05-36df-4148-9f12-7a8f516ad237 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105442025-05-22T21:26:43.556ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c7cddd9-d3a6-4dfc-b60b-83b7d26fbbce roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105452025-05-22T21:26:43.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c7cddd9-d3a6-4dfc-b60b-83b7d26fbbce resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105462025-05-22T21:26:43.559ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2608 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7c7cddd9-d3a6-4dfc-b60b-83b7d26fbbce response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105472025-05-22T21:26:44.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbe25924-a7f8-48fa-a9f1-07eedd332625 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105482025-05-22T21:26:44.573ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbe25924-a7f8-48fa-a9f1-07eedd332625 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105492025-05-22T21:26:44.575ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2649 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dbe25924-a7f8-48fa-a9f1-07eedd332625 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105502025-05-22T21:26:45.084ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
105512025-05-22T21:26:45.084ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105522025-05-22T21:26:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
105532025-05-22T21:26:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105542025-05-22T21:26:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105552025-05-22T21:26:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105562025-05-22T21:26:45.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105572025-05-22T21:26:45.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105582025-05-22T21:26:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105592025-05-22T21:26:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105602025-05-22T21:26:45.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105612025-05-22T21:26:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105622025-05-22T21:26:45.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105632025-05-22T21:26:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105642025-05-22T21:26:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105652025-05-22T21:26:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
105662025-05-22T21:26:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105672025-05-22T21:26:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105682025-05-22T21:26:45.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
105692025-05-22T21:26:45.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.021608ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
105702025-05-22T21:26:45.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.826589ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105712025-05-22T21:26:45.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9edcfabf-c7ad-4ad0-bce5-141db9a60c19 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105722025-05-22T21:26:45.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9edcfabf-c7ad-4ad0-bce5-141db9a60c19 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105732025-05-22T21:26:45.590ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9edcfabf-c7ad-4ad0-bce5-141db9a60c19 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105742025-05-22T21:26:46.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f99964b-18c4-49d1-9b9c-933edf8b1216 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105752025-05-22T21:26:46.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f99964b-18c4-49d1-9b9c-933edf8b1216 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105762025-05-22T21:26:46.606ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1865 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f99964b-18c4-49d1-9b9c-933edf8b1216 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105772025-05-22T21:26:47.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 12b5b716-cde2-45bc-adc5-ed2c65383e28 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105782025-05-22T21:26:47.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 12b5b716-cde2-45bc-adc5-ed2c65383e28 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105792025-05-22T21:26:47.621ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 12b5b716-cde2-45bc-adc5-ed2c65383e28 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105802025-05-22T21:26:48.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = cee538cf-8eec-4027-99c5-ec1e334d500e roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
105812025-05-22T21:26:48.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = cee538cf-8eec-4027-99c5-ec1e334d500e resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
105822025-05-22T21:26:48.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3692 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = cee538cf-8eec-4027-99c5-ec1e334d500e response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
105832025-05-22T21:26:48.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 2bf19041-594c-4e48-98ec-7f0a8401175e roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
105842025-05-22T21:26:48.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 2bf19041-594c-4e48-98ec-7f0a8401175e resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
105852025-05-22T21:26:48.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 440 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 0b21a0cb-df2a-4fa7-b7ab-701c2b53f3cd response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
105862025-05-22T21:26:48.160ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 2bf19041-594c-4e48-98ec-7f0a8401175e response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
105872025-05-22T21:26:48.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1d49d49-bf72-4799-816d-995f7fd24651 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105882025-05-22T21:26:48.634ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1d49d49-bf72-4799-816d-995f7fd24651 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105892025-05-22T21:26:48.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1d49d49-bf72-4799-816d-995f7fd24651 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105902025-05-22T21:26:49.649ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc000c8f-cf00-4a0c-8ac8-ca6dedee321c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105912025-05-22T21:26:49.649ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc000c8f-cf00-4a0c-8ac8-ca6dedee321c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105922025-05-22T21:26:49.656ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 6928 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bc000c8f-cf00-4a0c-8ac8-ca6dedee321c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105932025-05-22T21:26:50.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1bf44cef-de29-4f8d-b740-5c474c3bb3be roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105942025-05-22T21:26:50.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1bf44cef-de29-4f8d-b740-5c474c3bb3be resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105952025-05-22T21:26:50.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1998 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1bf44cef-de29-4f8d-b740-5c474c3bb3be response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105962025-05-22T21:26:51.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4237ad69-01e6-4cd4-84a0-f2573c1c29df roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105972025-05-22T21:26:51.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4237ad69-01e6-4cd4-84a0-f2573c1c29df resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105982025-05-22T21:26:51.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2230 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4237ad69-01e6-4cd4-84a0-f2573c1c29df response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
105992025-05-22T21:26:52.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c437e513-a408-42ed-8909-e5da10122bac roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106002025-05-22T21:26:52.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c437e513-a408-42ed-8909-e5da10122bac resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106012025-05-22T21:26:52.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c437e513-a408-42ed-8909-e5da10122bac response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106022025-05-22T21:26:53.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fec595b-d162-4262-92e8-fd9efb769a1c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106032025-05-22T21:26:53.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fec595b-d162-4262-92e8-fd9efb769a1c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106042025-05-22T21:26:53.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fec595b-d162-4262-92e8-fd9efb769a1c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106052025-05-22T21:26:54.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8d93ebd-69b8-4da2-a67e-a7d0e0e40258 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106062025-05-22T21:26:54.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8d93ebd-69b8-4da2-a67e-a7d0e0e40258 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106072025-05-22T21:26:54.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2212 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a8d93ebd-69b8-4da2-a67e-a7d0e0e40258 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106082025-05-22T21:26:55.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
106092025-05-22T21:26:55.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
106102025-05-22T21:26:55.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106112025-05-22T21:26:55.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106122025-05-22T21:26:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106132025-05-22T21:26:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106142025-05-22T21:26:55.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106152025-05-22T21:26:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106162025-05-22T21:26:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106172025-05-22T21:26:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106182025-05-22T21:26:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106192025-05-22T21:26:55.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106202025-05-22T21:26:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106212025-05-22T21:26:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
106222025-05-22T21:26:55.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106232025-05-22T21:26:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106242025-05-22T21:26:55.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
106252025-05-22T21:26:55.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.818425ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
106262025-05-22T21:26:55.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106272025-05-22T21:26:55.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106282025-05-22T21:26:55.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.967002ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
106292025-05-22T21:26:55.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08048d21-6619-460f-8b98-ffeb095b9900 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106302025-05-22T21:26:55.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08048d21-6619-460f-8b98-ffeb095b9900 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106312025-05-22T21:26:55.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 08048d21-6619-460f-8b98-ffeb095b9900 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106322025-05-22T21:26:56.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9abb41b6-2da0-48cd-9015-1bb1cfbbbf55 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106332025-05-22T21:26:56.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9abb41b6-2da0-48cd-9015-1bb1cfbbbf55 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106342025-05-22T21:26:56.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9abb41b6-2da0-48cd-9015-1bb1cfbbbf55 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106352025-05-22T21:26:57.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7792afdb-d565-464b-9e51-e7f03dc8a6c5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106362025-05-22T21:26:57.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7792afdb-d565-464b-9e51-e7f03dc8a6c5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106372025-05-22T21:26:57.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7792afdb-d565-464b-9e51-e7f03dc8a6c5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106382025-05-22T21:26:58.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 454 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = f1111481-575f-4dc7-9afa-86ba019d2603 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
106392025-05-22T21:26:58.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37c8f05c-56b9-4d79-aeff-1ab17a82f3f3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106402025-05-22T21:26:58.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37c8f05c-56b9-4d79-aeff-1ab17a82f3f3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106412025-05-22T21:26:58.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37c8f05c-56b9-4d79-aeff-1ab17a82f3f3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106422025-05-22T21:26:59.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a7d1534-bb9f-4338-ad54-fd4b24132ba0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106432025-05-22T21:26:59.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a7d1534-bb9f-4338-ad54-fd4b24132ba0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106442025-05-22T21:26:59.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2a7d1534-bb9f-4338-ad54-fd4b24132ba0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106452025-05-22T21:27:00.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97c225fd-02c9-4b6e-bb6f-e77c5e4b4ed0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106462025-05-22T21:27:00.833ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97c225fd-02c9-4b6e-bb6f-e77c5e4b4ed0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106472025-05-22T21:27:00.834ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 97c225fd-02c9-4b6e-bb6f-e77c5e4b4ed0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106482025-05-22T21:27:01.850ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a369220a-3870-485e-91ef-c3b02750fc95 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106492025-05-22T21:27:01.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a369220a-3870-485e-91ef-c3b02750fc95 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106502025-05-22T21:27:01.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2191 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a369220a-3870-485e-91ef-c3b02750fc95 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106512025-05-22T21:27:02.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac6f5aa-4fa6-44b4-9aea-02eff5f152dc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106522025-05-22T21:27:02.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac6f5aa-4fa6-44b4-9aea-02eff5f152dc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106532025-05-22T21:27:02.872ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = eac6f5aa-4fa6-44b4-9aea-02eff5f152dc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106542025-05-22T21:27:03.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd354e33-4c8d-4d7c-8f11-0d5aa4781f76 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106552025-05-22T21:27:03.887ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd354e33-4c8d-4d7c-8f11-0d5aa4781f76 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106562025-05-22T21:27:03.889ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2739 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd354e33-4c8d-4d7c-8f11-0d5aa4781f76 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106572025-05-22T21:27:04.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93158b86-c05e-4d2a-a333-f904f6258c88 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106582025-05-22T21:27:04.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93158b86-c05e-4d2a-a333-f904f6258c88 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106592025-05-22T21:27:04.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1992 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93158b86-c05e-4d2a-a333-f904f6258c88 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
106602025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
106612025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
106622025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106632025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
106642025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106652025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106662025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
106672025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
106682025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106692025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
106702025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
106712025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106722025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
106732025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
106742025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
106752025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106762025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
106772025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106782025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106792025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
106802025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106812025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
106822025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106832025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
106842025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106852025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
106862025-05-22T21:27:05.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
106872025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
106882025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106892025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106902025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
106912025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
106922025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106932025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
106942025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106952025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
106962025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
106972025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
106982025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
106992025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107002025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107012025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107022025-05-22T21:27:05.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
107032025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107042025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107052025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107062025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107072025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107082025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107092025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107102025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107112025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
107122025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107132025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
107142025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
107152025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107162025-05-22T21:27:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107172025-05-22T21:27:05.088ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.243408ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
107182025-05-22T21:27:05.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107192025-05-22T21:27:05.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107202025-05-22T21:27:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
107212025-05-22T21:27:05.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107222025-05-22T21:27:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
107232025-05-22T21:27:05.097ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 240276118 } })
107242025-05-22T21:27:05.097ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
107252025-05-22T21:27:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
107262025-05-22T21:27:05.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107272025-05-22T21:27:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107282025-05-22T21:27:05.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107292025-05-22T21:27:05.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 257150819 } })
107302025-05-22T21:27:05.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
107312025-05-22T21:27:05.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
107322025-05-22T21:27:05.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107332025-05-22T21:27:05.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107342025-05-22T21:27:05.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107352025-05-22T21:27:05.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107362025-05-22T21:27:05.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1534, tv_nsec: 265133498 } })
107372025-05-22T21:27:05.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
107382025-05-22T21:27:05.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 68.457149ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
107392025-05-22T21:27:05.155ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107402025-05-22T21:27:05.155ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
107412025-05-22T21:27:05.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107422025-05-22T21:27:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107432025-05-22T21:27:05.156ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107442025-05-22T21:27:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
107452025-05-22T21:27:05.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.001121ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107462025-05-22T21:27:05.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.808303ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
107472025-05-22T21:27:05.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107482025-05-22T21:27:05.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
107492025-05-22T21:27:05.161ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107502025-05-22T21:27:05.161ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107512025-05-22T21:27:05.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
107522025-05-22T21:27:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107532025-05-22T21:27:05.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107542025-05-22T21:27:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107552025-05-22T21:27:05.163ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107562025-05-22T21:27:05.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107572025-05-22T21:27:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107582025-05-22T21:27:05.164ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107592025-05-22T21:27:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107602025-05-22T21:27:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
107612025-05-22T21:27:05.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107622025-05-22T21:27:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107632025-05-22T21:27:05.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107642025-05-22T21:27:05.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.714991ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107652025-05-22T21:27:05.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107662025-05-22T21:27:05.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107672025-05-22T21:27:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107682025-05-22T21:27:05.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107692025-05-22T21:27:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
107702025-05-22T21:27:05.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107712025-05-22T21:27:05.171ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107722025-05-22T21:27:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107732025-05-22T21:27:05.174ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107742025-05-22T21:27:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107752025-05-22T21:27:05.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
107762025-05-22T21:27:05.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107772025-05-22T21:27:05.175ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 89.531063ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
107782025-05-22T21:27:05.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
107792025-05-22T21:27:05.175ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
107802025-05-22T21:27:05.175ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 90.352425ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
107812025-05-22T21:27:05.177ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.438621ms iteration = 20 status = 0
107822025-05-22T21:27:05.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
107832025-05-22T21:27:05.177ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107842025-05-22T21:27:05.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d873e96e-7fec-4282-a391-2129d0d51577", "content-length": "26", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
107852025-05-22T21:27:05.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107862025-05-22T21:27:05.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107872025-05-22T21:27:05.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107882025-05-22T21:27:05.189ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107892025-05-22T21:27:05.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107902025-05-22T21:27:05.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107912025-05-22T21:27:05.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107922025-05-22T21:27:05.194ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
107932025-05-22T21:27:05.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107942025-05-22T21:27:05.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107952025-05-22T21:27:05.202ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107962025-05-22T21:27:05.202ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
107972025-05-22T21:27:05.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107982025-05-22T21:27:05.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
107992025-05-22T21:27:05.214ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 128.791876ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108002025-05-22T21:27:05.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
108012025-05-22T21:27:05.216ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108022025-05-22T21:27:05.216ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b04f655-264d-4bfa-9d09-b8a9f91a22f6", "content-length": "26", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108032025-05-22T21:27:05.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108042025-05-22T21:27:05.216ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108052025-05-22T21:27:05.216ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108062025-05-22T21:27:05.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108072025-05-22T21:27:05.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
108082025-05-22T21:27:05.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108092025-05-22T21:27:05.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108102025-05-22T21:27:05.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108112025-05-22T21:27:05.219ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
108122025-05-22T21:27:05.219ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
108132025-05-22T21:27:05.219ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87afb9a3-7b27-4e74-99fa-b25415acf7f8", "content-length": "26", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108142025-05-22T21:27:05.219ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
108152025-05-22T21:27:05.221ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108162025-05-22T21:27:05.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
108172025-05-22T21:27:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
108182025-05-22T21:27:05.224ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108192025-05-22T21:27:05.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108202025-05-22T21:27:05.234ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108212025-05-22T21:27:05.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108222025-05-22T21:27:05.236ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108232025-05-22T21:27:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
108242025-05-22T21:27:05.238ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
108252025-05-22T21:27:05.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
108262025-05-22T21:27:05.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108272025-05-22T21:27:05.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108282025-05-22T21:27:05.246ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
108292025-05-22T21:27:05.246ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 161.140638ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
108302025-05-22T21:27:05.251ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108312025-05-22T21:27:05.251ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
108322025-05-22T21:27:05.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.836456ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
108332025-05-22T21:27:05.260ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108342025-05-22T21:27:05.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108352025-05-22T21:27:05.261ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 176.092379ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
108362025-05-22T21:27:05.262ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 177.272707ms iteration = 20 status = null
108372025-05-22T21:27:05.284ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
108382025-05-22T21:27:05.284ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 198.466762ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
108392025-05-22T21:27:05.301ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 216.243757ms iteration = 20 status = {}
108402025-05-22T21:27:05.330ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 245.171677ms iteration = 22 status = {"physical_disks_added":0}
108412025-05-22T21:27:05.344ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
108422025-05-22T21:27:05.344ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108432025-05-22T21:27:05.344ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcf2342f-edac-496b-b9c7-ac6c4b41140f", "content-length": "372", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108442025-05-22T21:27:05.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108452025-05-22T21:27:05.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108462025-05-22T21:27:05.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108472025-05-22T21:27:05.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108482025-05-22T21:27:05.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108492025-05-22T21:27:05.359ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108502025-05-22T21:27:05.359ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108512025-05-22T21:27:05.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108522025-05-22T21:27:05.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108532025-05-22T21:27:05.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
108542025-05-22T21:27:05.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108552025-05-22T21:27:05.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108562025-05-22T21:27:05.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108572025-05-22T21:27:05.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108582025-05-22T21:27:05.393ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
108592025-05-22T21:27:05.393ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108602025-05-22T21:27:05.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108612025-05-22T21:27:05.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
108622025-05-22T21:27:05.394ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
108632025-05-22T21:27:05.395ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2d2c5a0-17c3-4b81-89f9-7db25fb0079e", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108642025-05-22T21:27:05.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108652025-05-22T21:27:05.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108662025-05-22T21:27:05.397ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108672025-05-22T21:27:05.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108682025-05-22T21:27:05.400ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108692025-05-22T21:27:05.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108702025-05-22T21:27:05.401ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
108712025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
108722025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
108732025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
108742025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
108752025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108762025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108772025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108782025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108792025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
108802025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
108812025-05-22T21:27:05.403ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
108822025-05-22T21:27:05.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108832025-05-22T21:27:05.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108842025-05-22T21:27:05.405ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
108852025-05-22T21:27:05.405ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
108862025-05-22T21:27:05.406ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
108872025-05-22T21:27:05.406ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
108882025-05-22T21:27:05.501ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e40ec405-fbee-4b0b-9071-f9cf43d919d0", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108892025-05-22T21:27:05.502ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 416.955154ms iteration = 20 status = {}
108902025-05-22T21:27:05.502ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "995e54b2-4ebd-476c-a896-00ae28fd9a9f", "content-length": "691", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108912025-05-22T21:27:05.502ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
108922025-05-22T21:27:05.502ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
108932025-05-22T21:27:05.502ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
108942025-05-22T21:27:05.503ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.444476ms iteration = 20 status = {}
108952025-05-22T21:27:05.614ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "beb3f646-d176-435c-bbea-44fc37268ae9", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108962025-05-22T21:27:05.614ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
108972025-05-22T21:27:05.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108982025-05-22T21:27:05.614ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9cdb07a-5a76-4c01-8b15-22a35cd0f0b1", "content-length": "682", "date": "Thu, 22 May 2025 21:27:05 GMT"} })
108992025-05-22T21:27:05.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109002025-05-22T21:27:05.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109012025-05-22T21:27:05.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109022025-05-22T21:27:05.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109032025-05-22T21:27:05.620ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109042025-05-22T21:27:05.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109052025-05-22T21:27:05.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109062025-05-22T21:27:05.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109072025-05-22T21:27:05.630ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.183692ms iteration = 20 status = {}
109082025-05-22T21:27:05.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72c146b7-0d07-443c-84c2-4de7ed7765e9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109092025-05-22T21:27:05.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72c146b7-0d07-443c-84c2-4de7ed7765e9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109102025-05-22T21:27:05.961ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72c146b7-0d07-443c-84c2-4de7ed7765e9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109112025-05-22T21:27:06.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15631c10-8bd0-4eeb-a5b9-a57f3be825d1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109122025-05-22T21:27:06.976ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15631c10-8bd0-4eeb-a5b9-a57f3be825d1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109132025-05-22T21:27:06.978ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 15631c10-8bd0-4eeb-a5b9-a57f3be825d1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109142025-05-22T21:27:07.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e1cf3c0-2b07-434f-97bd-71267d54e366 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109152025-05-22T21:27:07.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e1cf3c0-2b07-434f-97bd-71267d54e366 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109162025-05-22T21:27:07.994ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e1cf3c0-2b07-434f-97bd-71267d54e366 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109172025-05-22T21:27:08.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 469 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 49810e61-d630-4bbe-9380-627de3a2a290 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
109182025-05-22T21:27:09.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 42d09ca1-5987-461c-ba84-1f4258b17333 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109192025-05-22T21:27:09.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 42d09ca1-5987-461c-ba84-1f4258b17333 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109202025-05-22T21:27:09.009ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 42d09ca1-5987-461c-ba84-1f4258b17333 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109212025-05-22T21:27:10.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9d332e-bded-46c8-84ef-cf090198dbe4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109222025-05-22T21:27:10.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9d332e-bded-46c8-84ef-cf090198dbe4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109232025-05-22T21:27:10.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2336 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dd9d332e-bded-46c8-84ef-cf090198dbe4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109242025-05-22T21:27:11.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4de66a8e-e31d-4898-82c1-e95ac9e959e3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109252025-05-22T21:27:11.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4de66a8e-e31d-4898-82c1-e95ac9e959e3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109262025-05-22T21:27:11.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2011 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4de66a8e-e31d-4898-82c1-e95ac9e959e3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109272025-05-22T21:27:12.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 301678ad-e8b8-40ff-b496-c5fe467c7778 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109282025-05-22T21:27:12.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 301678ad-e8b8-40ff-b496-c5fe467c7778 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109292025-05-22T21:27:12.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 301678ad-e8b8-40ff-b496-c5fe467c7778 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109302025-05-22T21:27:13.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 898e8480-f3ca-45ee-9641-29685c1a3712 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109312025-05-22T21:27:13.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 898e8480-f3ca-45ee-9641-29685c1a3712 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109322025-05-22T21:27:13.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 898e8480-f3ca-45ee-9641-29685c1a3712 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109332025-05-22T21:27:14.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 78628366-95c6-44a3-bbd0-286c2fe3081b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109342025-05-22T21:27:14.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 78628366-95c6-44a3-bbd0-286c2fe3081b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109352025-05-22T21:27:14.091ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2825 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 78628366-95c6-44a3-bbd0-286c2fe3081b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109362025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
109372025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
109382025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109392025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109402025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109412025-05-22T21:27:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109422025-05-22T21:27:15.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109432025-05-22T21:27:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109442025-05-22T21:27:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109452025-05-22T21:27:15.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.482586ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109462025-05-22T21:27:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109472025-05-22T21:27:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109482025-05-22T21:27:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109492025-05-22T21:27:15.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109502025-05-22T21:27:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109512025-05-22T21:27:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109522025-05-22T21:27:15.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
109532025-05-22T21:27:15.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109542025-05-22T21:27:15.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109552025-05-22T21:27:15.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b8035c4-c52e-46dc-bbd3-c693a5a5412c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109562025-05-22T21:27:15.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b8035c4-c52e-46dc-bbd3-c693a5a5412c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109572025-05-22T21:27:15.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
109582025-05-22T21:27:15.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.939792ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
109592025-05-22T21:27:15.106ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1732 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9b8035c4-c52e-46dc-bbd3-c693a5a5412c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109602025-05-22T21:27:16.121ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9433bf2b-1b63-49ee-acf5-0825b951a20c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109612025-05-22T21:27:16.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9433bf2b-1b63-49ee-acf5-0825b951a20c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109622025-05-22T21:27:16.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9433bf2b-1b63-49ee-acf5-0825b951a20c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109632025-05-22T21:27:17.137ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 735c9d91-95fa-43cb-afb3-0ab0cb8b0546 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109642025-05-22T21:27:17.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 735c9d91-95fa-43cb-afb3-0ab0cb8b0546 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109652025-05-22T21:27:17.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2287 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 735c9d91-95fa-43cb-afb3-0ab0cb8b0546 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109662025-05-22T21:27:18.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a85d4b64-d52a-44ec-a6b6-91fd872fce74 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109672025-05-22T21:27:18.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a85d4b64-d52a-44ec-a6b6-91fd872fce74 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109682025-05-22T21:27:18.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 4eb46741-432c-4e62-8c5d-f1f178be80e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
109692025-05-22T21:27:18.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 4eb46741-432c-4e62-8c5d-f1f178be80e1 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
109702025-05-22T21:27:18.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2265 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a85d4b64-d52a-44ec-a6b6-91fd872fce74 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109712025-05-22T21:27:18.156ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2710 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = 4eb46741-432c-4e62-8c5d-f1f178be80e1 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
109722025-05-22T21:27:18.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = a037d727-8452-4d89-8483-25b73421eef3 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
109732025-05-22T21:27:18.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = a037d727-8452-4d89-8483-25b73421eef3 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
109742025-05-22T21:27:18.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:39537 req_id = a037d727-8452-4d89-8483-25b73421eef3 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
109752025-05-22T21:27:18.159ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 498 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = dad9882d-8067-4a31-9a82-91ae1b589119 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
109762025-05-22T21:27:19.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5ca493a7-e461-4def-bd69-89f50f28e25b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109772025-05-22T21:27:19.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5ca493a7-e461-4def-bd69-89f50f28e25b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109782025-05-22T21:27:19.171ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5ca493a7-e461-4def-bd69-89f50f28e25b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109792025-05-22T21:27:20.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33adb886-9ffa-450e-8dbc-a20fb0772000 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109802025-05-22T21:27:20.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33adb886-9ffa-450e-8dbc-a20fb0772000 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109812025-05-22T21:27:20.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2879 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 33adb886-9ffa-450e-8dbc-a20fb0772000 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109822025-05-22T21:27:21.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a214c7-0c87-48d3-ab3b-f87be968e096 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109832025-05-22T21:27:21.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a214c7-0c87-48d3-ab3b-f87be968e096 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109842025-05-22T21:27:21.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2016 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f1a214c7-0c87-48d3-ab3b-f87be968e096 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109852025-05-22T21:27:22.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32893ae3-bb68-4b38-ba51-245e853f21dc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109862025-05-22T21:27:22.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32893ae3-bb68-4b38-ba51-245e853f21dc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109872025-05-22T21:27:22.220ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 32893ae3-bb68-4b38-ba51-245e853f21dc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109882025-05-22T21:27:23.233ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7743d335-51bf-499b-95f7-1b4067b76fee roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109892025-05-22T21:27:23.234ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7743d335-51bf-499b-95f7-1b4067b76fee resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109902025-05-22T21:27:23.235ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7743d335-51bf-499b-95f7-1b4067b76fee response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109912025-05-22T21:27:24.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 30dc798e-3032-40be-b391-0758e0dbf739 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109922025-05-22T21:27:24.250ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 30dc798e-3032-40be-b391-0758e0dbf739 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109932025-05-22T21:27:24.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1789 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 30dc798e-3032-40be-b391-0758e0dbf739 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
109942025-05-22T21:27:25.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
109952025-05-22T21:27:25.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
109962025-05-22T21:27:25.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109972025-05-22T21:27:25.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109982025-05-22T21:27:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109992025-05-22T21:27:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110002025-05-22T21:27:25.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110012025-05-22T21:27:25.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110022025-05-22T21:27:25.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110032025-05-22T21:27:25.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.143047ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110042025-05-22T21:27:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110052025-05-22T21:27:25.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110062025-05-22T21:27:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110072025-05-22T21:27:25.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110082025-05-22T21:27:25.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110092025-05-22T21:27:25.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110102025-05-22T21:27:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
110112025-05-22T21:27:25.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110122025-05-22T21:27:25.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110132025-05-22T21:27:25.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
110142025-05-22T21:27:25.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.627607ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
110152025-05-22T21:27:25.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7ad19209-0bf8-49db-bc8a-f718a81a9d0b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110162025-05-22T21:27:25.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7ad19209-0bf8-49db-bc8a-f718a81a9d0b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110172025-05-22T21:27:25.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2325 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7ad19209-0bf8-49db-bc8a-f718a81a9d0b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110182025-05-22T21:27:26.280ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 56309454-db50-4e94-af2c-1a89ad10e951 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110192025-05-22T21:27:26.280ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 56309454-db50-4e94-af2c-1a89ad10e951 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110202025-05-22T21:27:26.282ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 56309454-db50-4e94-af2c-1a89ad10e951 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110212025-05-22T21:27:27.296ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5423c9ec-f9ae-4fb2-ba1d-e09a76f99645 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110222025-05-22T21:27:27.296ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5423c9ec-f9ae-4fb2-ba1d-e09a76f99645 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110232025-05-22T21:27:27.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5423c9ec-f9ae-4fb2-ba1d-e09a76f99645 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110242025-05-22T21:27:28.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 817 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 726281f6-bbb4-4b18-b84b-d6dc7bb78159 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
110252025-05-22T21:27:28.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f684253-dd68-4ae0-9c4b-251be575253d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110262025-05-22T21:27:28.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f684253-dd68-4ae0-9c4b-251be575253d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110272025-05-22T21:27:28.313ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f684253-dd68-4ae0-9c4b-251be575253d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110282025-05-22T21:27:29.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a297dcf-f648-402b-a071-c67b302a532f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110292025-05-22T21:27:29.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a297dcf-f648-402b-a071-c67b302a532f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110302025-05-22T21:27:29.330ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0a297dcf-f648-402b-a071-c67b302a532f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110312025-05-22T21:27:30.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e9c8779-26b1-45b3-8dc1-965dbb7bedd6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110322025-05-22T21:27:30.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e9c8779-26b1-45b3-8dc1-965dbb7bedd6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110332025-05-22T21:27:30.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2030 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9e9c8779-26b1-45b3-8dc1-965dbb7bedd6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110342025-05-22T21:27:31.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d313049-fb39-435a-b7b7-6ef1f098edfe roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110352025-05-22T21:27:31.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d313049-fb39-435a-b7b7-6ef1f098edfe resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110362025-05-22T21:27:31.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8d313049-fb39-435a-b7b7-6ef1f098edfe response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110372025-05-22T21:27:32.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a8d0ba-010b-4273-986f-db8c76b3a636 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110382025-05-22T21:27:32.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a8d0ba-010b-4273-986f-db8c76b3a636 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110392025-05-22T21:27:32.377ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d6a8d0ba-010b-4273-986f-db8c76b3a636 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110402025-05-22T21:27:33.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ee286ce-cd39-4544-97e3-7e29d516f259 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110412025-05-22T21:27:33.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ee286ce-cd39-4544-97e3-7e29d516f259 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110422025-05-22T21:27:33.393ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2402 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2ee286ce-cd39-4544-97e3-7e29d516f259 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110432025-05-22T21:27:34.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d993809b-3382-419b-b219-127f46064557 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110442025-05-22T21:27:34.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d993809b-3382-419b-b219-127f46064557 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110452025-05-22T21:27:34.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d993809b-3382-419b-b219-127f46064557 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
110462025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
110472025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
110482025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110492025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
110502025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110512025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110522025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
110532025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
110542025-05-22T21:27:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
110552025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
110562025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110572025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110582025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
110592025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110602025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
110612025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110622025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
110632025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110642025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
110652025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
110662025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110672025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
110682025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110692025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
110702025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
110712025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110722025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
110732025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
110742025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
110752025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
110762025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110772025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
110782025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110792025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
110802025-05-22T21:27:35.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110812025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110822025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
110832025-05-22T21:27:35.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:17:35.086134694 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110842025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110852025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
110862025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
110872025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
110882025-05-22T21:27:35.086ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
110892025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110902025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.11\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
110912025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
110922025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110932025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
110942025-05-22T21:27:35.086ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
110952025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110962025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
110972025-05-22T21:27:35.086ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
110982025-05-22T21:27:35.086ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
110992025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
111002025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111012025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
111022025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111032025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
111042025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111052025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
111062025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
111072025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
111082025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111092025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 11 reason = Timeout
111102025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
111112025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
111122025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
111132025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
111142025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111152025-05-22T21:27:35.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
111162025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
111172025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
111182025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
111192025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
111202025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
111212025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111222025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
111232025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
111242025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111252025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
111262025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111272025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
111282025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111292025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111302025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
111312025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111322025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111332025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
111342025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111352025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111362025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111372025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111382025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111392025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111402025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111412025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111422025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
111432025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
111442025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
111452025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111462025-05-22T21:27:35.086ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
111472025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111482025-05-22T21:27:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111492025-05-22T21:27:35.086ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 229625148 } })
111502025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111512025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111522025-05-22T21:27:35.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 229634748 } })
111532025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111542025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
111552025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
111562025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111572025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
111582025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
111592025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111602025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 11 reason = Timeout
111612025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
111622025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
111632025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
111642025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.35487ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
111652025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
111662025-05-22T21:27:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.358461ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
111672025-05-22T21:27:35.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111682025-05-22T21:27:35.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111692025-05-22T21:27:35.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111702025-05-22T21:27:35.091ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.3623ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111712025-05-22T21:27:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111722025-05-22T21:27:35.092ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111732025-05-22T21:27:35.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111742025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111752025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111762025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111772025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111782025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111792025-05-22T21:27:35.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111802025-05-22T21:27:35.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111812025-05-22T21:27:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111822025-05-22T21:27:35.103ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111832025-05-22T21:27:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111842025-05-22T21:27:35.108ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111852025-05-22T21:27:35.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111862025-05-22T21:27:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111872025-05-22T21:27:35.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111882025-05-22T21:27:35.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111892025-05-22T21:27:35.111ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111902025-05-22T21:27:35.111ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 254220264 } })
111912025-05-22T21:27:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111922025-05-22T21:27:35.111ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
111932025-05-22T21:27:35.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
111942025-05-22T21:27:35.112ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111952025-05-22T21:27:35.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111962025-05-22T21:27:35.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111972025-05-22T21:27:35.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111982025-05-22T21:27:35.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111992025-05-22T21:27:35.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112002025-05-22T21:27:35.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112012025-05-22T21:27:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112022025-05-22T21:27:35.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112032025-05-22T21:27:35.118ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:17:35.086134694 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
112042025-05-22T21:27:35.118ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 31.993986ms iteration = 11 status = {"expiration":"2025-05-22T21:17:35.086134694Z","pruned":[]}
112052025-05-22T21:27:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
112062025-05-22T21:27:35.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112072025-05-22T21:27:35.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112082025-05-22T21:27:35.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112092025-05-22T21:27:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112102025-05-22T21:27:35.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112112025-05-22T21:27:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112122025-05-22T21:27:35.127ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 270165032 } })
112132025-05-22T21:27:35.127ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
112142025-05-22T21:27:35.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112152025-05-22T21:27:35.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112162025-05-22T21:27:35.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112172025-05-22T21:27:35.129ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112182025-05-22T21:27:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112192025-05-22T21:27:35.130ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 43.717241ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
112202025-05-22T21:27:35.131ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
112212025-05-22T21:27:35.131ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
112222025-05-22T21:27:35.131ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 44.838387ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
112232025-05-22T21:27:35.131ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112242025-05-22T21:27:35.131ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112252025-05-22T21:27:35.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112262025-05-22T21:27:35.136ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112272025-05-22T21:27:35.136ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112282025-05-22T21:27:35.138ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
112292025-05-22T21:27:35.138ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 51.04093ms iteration = 11 status = {"by_rx":{},"error":null}
112302025-05-22T21:27:35.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112312025-05-22T21:27:35.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112322025-05-22T21:27:35.139ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112332025-05-22T21:27:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112342025-05-22T21:27:35.140ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
112352025-05-22T21:27:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
112362025-05-22T21:27:35.140ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112372025-05-22T21:27:35.140ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112382025-05-22T21:27:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
112392025-05-22T21:27:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112402025-05-22T21:27:35.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112412025-05-22T21:27:35.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112422025-05-22T21:27:35.145ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 288118029 } })
112432025-05-22T21:27:35.145ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
112442025-05-22T21:27:35.146ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112452025-05-22T21:27:35.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112462025-05-22T21:27:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112472025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112482025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112492025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112502025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112512025-05-22T21:27:35.149ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112522025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112532025-05-22T21:27:35.149ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112542025-05-22T21:27:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112552025-05-22T21:27:35.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112562025-05-22T21:27:35.151ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112572025-05-22T21:27:35.152ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112582025-05-22T21:27:35.157ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.86895ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
112592025-05-22T21:27:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112602025-05-22T21:27:35.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112612025-05-22T21:27:35.159ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
112622025-05-22T21:27:35.159ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
112632025-05-22T21:27:35.159ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
112642025-05-22T21:27:35.159ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112652025-05-22T21:27:35.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 73.92836ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112662025-05-22T21:27:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112672025-05-22T21:27:35.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.737962ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
112682025-05-22T21:27:35.161ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112692025-05-22T21:27:35.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112702025-05-22T21:27:35.163ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
112712025-05-22T21:27:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
112722025-05-22T21:27:35.168ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112732025-05-22T21:27:35.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112742025-05-22T21:27:35.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
112752025-05-22T21:27:35.172ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112762025-05-22T21:27:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
112772025-05-22T21:27:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112782025-05-22T21:27:35.173ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112792025-05-22T21:27:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112802025-05-22T21:27:35.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112812025-05-22T21:27:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112822025-05-22T21:27:35.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112832025-05-22T21:27:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112842025-05-22T21:27:35.179ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112852025-05-22T21:27:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112862025-05-22T21:27:35.182ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112872025-05-22T21:27:35.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112882025-05-22T21:27:35.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112892025-05-22T21:27:35.185ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
112902025-05-22T21:27:35.185ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 99.540271ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
112912025-05-22T21:27:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112922025-05-22T21:27:35.198ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
112932025-05-22T21:27:35.203ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 117.879333ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
112942025-05-22T21:27:35.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 118.174278ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112952025-05-22T21:27:35.209ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
112962025-05-22T21:27:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
112972025-05-22T21:27:35.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112982025-05-22T21:27:35.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112992025-05-22T21:27:35.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113002025-05-22T21:27:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113012025-05-22T21:27:35.218ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113022025-05-22T21:27:35.218ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.753494ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113032025-05-22T21:27:35.224ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
113042025-05-22T21:27:35.224ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
113052025-05-22T21:27:35.224ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 137.725549ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
113062025-05-22T21:27:35.225ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
113072025-05-22T21:27:35.225ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
113082025-05-22T21:27:35.225ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
113092025-05-22T21:27:35.225ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113102025-05-22T21:27:35.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113112025-05-22T21:27:35.233ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113122025-05-22T21:27:35.236ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113132025-05-22T21:27:35.236ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113142025-05-22T21:27:35.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113152025-05-22T21:27:35.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113162025-05-22T21:27:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
113172025-05-22T21:27:35.237ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
113182025-05-22T21:27:35.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
113192025-05-22T21:27:35.266ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
113202025-05-22T21:27:35.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
113212025-05-22T21:27:35.279ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
113222025-05-22T21:27:35.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113232025-05-22T21:27:35.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113242025-05-22T21:27:35.356ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
113252025-05-22T21:27:35.356ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113262025-05-22T21:27:35.357ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3f8f276-0eff-4837-88ad-397ac8fdd5ce", "content-length": "372", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
113272025-05-22T21:27:35.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113282025-05-22T21:27:35.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113292025-05-22T21:27:35.358ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113302025-05-22T21:27:35.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113312025-05-22T21:27:35.359ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113322025-05-22T21:27:35.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113332025-05-22T21:27:35.360ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 273.853345ms iteration = 11 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
113342025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113352025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113362025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113372025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
113382025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113392025-05-22T21:27:35.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113402025-05-22T21:27:35.364ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
113412025-05-22T21:27:35.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113422025-05-22T21:27:35.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113432025-05-22T21:27:35.371ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113442025-05-22T21:27:35.375ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(9428e9c9-77d0-44b7-9cdd-7a41b09aa246, 0), (792becc0-bb84-40a0-8ca4-5b33a0fc21d4, 0), (6ab0bcf6-1fbb-4715-8c4b-36966aa111ba, 0)]
113452025-05-22T21:27:35.376ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1564, tv_nsec: 518983994 } })
113462025-05-22T21:27:35.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
113472025-05-22T21:27:35.379ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113482025-05-22T21:27:35.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113492025-05-22T21:27:35.382ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 296.795126ms iteration = 21 status = 0
113502025-05-22T21:27:35.384ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
113512025-05-22T21:27:35.385ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 299.171071ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
113522025-05-22T21:27:35.409ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113532025-05-22T21:27:35.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113542025-05-22T21:27:35.412ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113552025-05-22T21:27:35.415ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 329.815428ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113562025-05-22T21:27:35.416ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113572025-05-22T21:27:35.416ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113582025-05-22T21:27:35.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113592025-05-22T21:27:35.420ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113602025-05-22T21:27:35.420ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
113612025-05-22T21:27:35.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113622025-05-22T21:27:35.420ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113632025-05-22T21:27:35.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113642025-05-22T21:27:35.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5292bf6c-62ab-4df2-a18a-90ae0d851166 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
113652025-05-22T21:27:35.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5292bf6c-62ab-4df2-a18a-90ae0d851166 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
113662025-05-22T21:27:35.422ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113672025-05-22T21:27:35.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113682025-05-22T21:27:35.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113692025-05-22T21:27:35.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113702025-05-22T21:27:35.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113712025-05-22T21:27:35.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113722025-05-22T21:27:35.426ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113732025-05-22T21:27:35.427ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113742025-05-22T21:27:35.427ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113752025-05-22T21:27:35.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113762025-05-22T21:27:35.429ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
113772025-05-22T21:27:35.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
113782025-05-22T21:27:35.430ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113792025-05-22T21:27:35.430ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113802025-05-22T21:27:35.432ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
113812025-05-22T21:27:35.432ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113822025-05-22T21:27:35.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113832025-05-22T21:27:35.432ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113842025-05-22T21:27:35.432ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113852025-05-22T21:27:35.432ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 346.584477ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113862025-05-22T21:27:35.433ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
113872025-05-22T21:27:35.433ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
113882025-05-22T21:27:35.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
113892025-05-22T21:27:35.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 13428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5292bf6c-62ab-4df2-a18a-90ae0d851166 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
113902025-05-22T21:27:35.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113912025-05-22T21:27:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113922025-05-22T21:27:35.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113932025-05-22T21:27:35.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113942025-05-22T21:27:35.437ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
113952025-05-22T21:27:35.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
113962025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113972025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113982025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113992025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c530b88-802c-499e-8586-a6885bbd6a9b", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114002025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114012025-05-22T21:27:35.438ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
114022025-05-22T21:27:35.438ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114032025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114042025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
114052025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
114062025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
114072025-05-22T21:27:35.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 352.475674ms iteration = 11 status = {"generation":2}
114082025-05-22T21:27:35.439ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2cc4c93b-20cb-43dd-bdcf-0b9e052a1d68", "content-length": "26", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114092025-05-22T21:27:35.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114102025-05-22T21:27:35.439ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
114112025-05-22T21:27:35.439ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114122025-05-22T21:27:35.439ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "200a4bc5-44d0-4a5d-bb21-2378ebdc1044", "content-length": "26", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114132025-05-22T21:27:35.439ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114142025-05-22T21:27:35.446ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114152025-05-22T21:27:35.446ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114162025-05-22T21:27:35.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114172025-05-22T21:27:35.447ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114182025-05-22T21:27:35.451ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114192025-05-22T21:27:35.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114202025-05-22T21:27:35.455ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
114212025-05-22T21:27:35.455ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114222025-05-22T21:27:35.456ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b3b65233-c44c-45e4-ae65-8937256f1134", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114232025-05-22T21:27:35.458ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 372.013196ms iteration = 21 status = {}
114242025-05-22T21:27:35.458ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
114252025-05-22T21:27:35.458ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114262025-05-22T21:27:35.458ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83360d8a-029d-48b5-ac69-47e56a8964b6", "content-length": "26", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114272025-05-22T21:27:35.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114282025-05-22T21:27:35.461ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
114292025-05-22T21:27:35.469ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114302025-05-22T21:27:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
114312025-05-22T21:27:35.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114322025-05-22T21:27:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114332025-05-22T21:27:35.476ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
114342025-05-22T21:27:35.476ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 390.240786ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
114352025-05-22T21:27:35.479ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 392.816325ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
114362025-05-22T21:27:35.484ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114372025-05-22T21:27:35.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
114382025-05-22T21:27:35.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
114392025-05-22T21:27:35.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114402025-05-22T21:27:35.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114412025-05-22T21:27:35.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
114422025-05-22T21:27:35.487ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
114432025-05-22T21:27:35.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
114442025-05-22T21:27:35.487ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114452025-05-22T21:27:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
114462025-05-22T21:27:35.494ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
114472025-05-22T21:27:35.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
114482025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
114492025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
114502025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
114512025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
114522025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 412.199843ms iteration = 11 status = {"generation":1}
114532025-05-22T21:27:35.498ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
114542025-05-22T21:27:35.502ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
114552025-05-22T21:27:35.502ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 416.71342ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
114562025-05-22T21:27:35.523ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114572025-05-22T21:27:35.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114582025-05-22T21:27:35.525ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 439.346347ms iteration = 23 status = {"physical_disks_added":0}
114592025-05-22T21:27:35.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
114602025-05-22T21:27:35.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "91cbfb3f-5275-44c6-9217-ecca9fba9482", "date": "Thu, 22 May 2025 21:27:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114612025-05-22T21:27:35.580ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114622025-05-22T21:27:35.583ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "4ff8805c-f0d7-4388-a5b0-6c8550244dff", "date": "Thu, 22 May 2025 21:27:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114632025-05-22T21:27:35.583ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114642025-05-22T21:27:35.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "a41ef39a-c54e-42bb-9a54-243f9125a778", "date": "Thu, 22 May 2025 21:27:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114652025-05-22T21:27:35.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114662025-05-22T21:27:35.601ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
114672025-05-22T21:27:35.601ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 515.859386ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
114682025-05-22T21:27:35.628ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
114692025-05-22T21:27:35.628ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 542.609944ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114702025-05-22T21:27:35.636ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
114712025-05-22T21:27:35.637ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "8beb2785-d8f5-40f7-a7ff-7d5faf613554", "date": "Thu, 22 May 2025 21:27:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114722025-05-22T21:27:35.637ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114732025-05-22T21:27:35.646ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "36f19793-6085-477c-acc1-fc6ba5011ecf", "date": "Thu, 22 May 2025 21:27:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114742025-05-22T21:27:35.646ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114752025-05-22T21:27:35.649ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
114762025-05-22T21:27:35.649ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 562.875616ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
114772025-05-22T21:27:35.665ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114782025-05-22T21:27:35.665ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114792025-05-22T21:27:35.665ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114802025-05-22T21:27:35.665ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "72004427-73d2-45e1-a1d6-e5feb47af02e", "content-length": "476", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114812025-05-22T21:27:35.665ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114822025-05-22T21:27:35.666ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6551d76-26e3-4751-b5bf-e61f31db5f84", "content-length": "734", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114832025-05-22T21:27:35.666ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114842025-05-22T21:27:35.666ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "992d2ed1-1d2a-4d5b-85de-324bd7bed163", "content-length": "111", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114852025-05-22T21:27:35.666ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114862025-05-22T21:27:35.667ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "c949fdb6-f7d2-4f85-9645-4801b49401e9", "content-length": "111", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114872025-05-22T21:27:35.667ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114882025-05-22T21:27:35.667ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5719717f-0aff-4286-ac79-7edf1557b324", "content-length": "170", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114892025-05-22T21:27:35.667ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114902025-05-22T21:27:35.668ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "858a68a0-db60-4f4d-b064-135b7b15b055", "content-length": "170", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114912025-05-22T21:27:35.668ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114922025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6f0d4b3-8a62-4761-ace2-8ef2189d39cb", "content-length": "179", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114932025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114942025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cba7c9d-14d1-4a56-ae95-2c5d0712166a", "content-length": "179", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114952025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114962025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c40e4ccf-4d99-4816-b6fb-b9e5324cdeb3", "content-length": "702", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114972025-05-22T21:27:35.669ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114982025-05-22T21:27:35.670ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d643e1f-12c1-4225-9117-2eb205fc08c3", "content-length": "727", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
114992025-05-22T21:27:35.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
115002025-05-22T21:27:35.671ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce2d4470-d7ab-4361-aa40-6dddd3f09ebf", "content-length": "729", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115012025-05-22T21:27:35.671ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
115022025-05-22T21:27:35.674ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5e149b9-5a0f-4463-ac60-0a835320e2a8", "content-length": "728", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115032025-05-22T21:27:35.674ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
115042025-05-22T21:27:35.676ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7a3b391-afb5-4589-a690-c92c4592a09b", "content-length": "722", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115052025-05-22T21:27:35.676ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
115062025-05-22T21:27:35.677ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a83d6b98-3b55-4c36-a669-882981ecfba8", "content-length": "109", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115072025-05-22T21:27:35.677ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
115082025-05-22T21:27:35.678ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0cfc38a8-418a-4310-87c9-11e773aa490f", "content-length": "109", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115092025-05-22T21:27:35.678ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
115102025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "037ba028-c156-46fa-a332-73b391bfac26", "content-length": "169", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115112025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
115122025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "73fa42f4-2037-4f09-8c92-6745027c1aa6", "content-length": "169", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115132025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
115142025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9461263-b9c7-4c56-a897-103869d5bf19", "content-length": "178", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115152025-05-22T21:27:35.679ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
115162025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "75439551-d10c-4881-b835-24f797d2fa1f", "content-length": "178", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115172025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
115182025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "92b982b5-adf4-4015-b7c2-d1ad7c23069c", "content-length": "702", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115192025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115202025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "457521d8-4b37-4e0f-9d0d-ae1fbdcf82f1", "content-length": "727", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115212025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115222025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9db3bf8-8ee3-4fbf-be34-2e17af81a254", "content-length": "729", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115232025-05-22T21:27:35.680ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115242025-05-22T21:27:35.681ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6c1d545-a30b-41a4-bfcc-94f85881baae", "content-length": "728", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
115252025-05-22T21:27:35.681ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115262025-05-22T21:27:35.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115272025-05-22T21:27:35.712ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 626.597584ms iteration = 21 status = {}
115282025-05-22T21:27:35.726ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
115292025-05-22T21:27:35.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
115302025-05-22T21:27:35.730ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
115312025-05-22T21:27:35.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
115322025-05-22T21:27:35.744ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115332025-05-22T21:27:35.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115342025-05-22T21:27:35.754ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 668.749921ms iteration = 21 status = null
115352025-05-22T21:27:35.756ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115362025-05-22T21:27:35.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115372025-05-22T21:27:35.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115382025-05-22T21:27:35.802ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115392025-05-22T21:27:35.805ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115402025-05-22T21:27:35.805ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115412025-05-22T21:27:35.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115422025-05-22T21:27:35.814ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115432025-05-22T21:27:35.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115442025-05-22T21:27:35.817ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115452025-05-22T21:27:35.820ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115462025-05-22T21:27:35.821ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115472025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
115482025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115492025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
115502025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
115512025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115522025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115532025-05-22T21:27:35.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
115542025-05-22T21:27:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115552025-05-22T21:27:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
115562025-05-22T21:27:35.825ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
115572025-05-22T21:27:35.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
115582025-05-22T21:27:35.828ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
115592025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115602025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
115612025-05-22T21:27:35.828ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
115622025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 742.248895ms iteration = 5 status = {"blueprint_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","inventory_collection_id":"6ab0bcf6-1fbb-4715-8c4b-36966aa111ba","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
115632025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115642025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
115652025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115662025-05-22T21:27:35.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115672025-05-22T21:27:35.830ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115682025-05-22T21:27:35.831ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115692025-05-22T21:27:35.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115702025-05-22T21:27:35.832ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
115712025-05-22T21:27:35.832ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
115722025-05-22T21:27:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
115732025-05-22T21:27:35.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115742025-05-22T21:27:35.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115752025-05-22T21:27:35.835ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
115762025-05-22T21:27:35.835ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115772025-05-22T21:27:35.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115782025-05-22T21:27:35.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115792025-05-22T21:27:35.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115802025-05-22T21:27:35.839ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115812025-05-22T21:27:35.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115822025-05-22T21:27:35.840ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115832025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115842025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
115852025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115862025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115872025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115882025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115892025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115902025-05-22T21:27:35.841ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115912025-05-22T21:27:35.842ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115922025-05-22T21:27:35.842ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115932025-05-22T21:27:35.842ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
115942025-05-22T21:27:35.842ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115952025-05-22T21:27:35.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115962025-05-22T21:27:35.844ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
115972025-05-22T21:27:35.844ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115982025-05-22T21:27:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
115992025-05-22T21:27:35.845ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116002025-05-22T21:27:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116012025-05-22T21:27:35.846ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116022025-05-22T21:27:35.847ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116032025-05-22T21:27:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116042025-05-22T21:27:35.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
116052025-05-22T21:27:35.848ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116062025-05-22T21:27:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116072025-05-22T21:27:35.849ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116082025-05-22T21:27:35.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116092025-05-22T21:27:35.851ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116102025-05-22T21:27:35.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116112025-05-22T21:27:35.854ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116122025-05-22T21:27:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116132025-05-22T21:27:35.881ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a86e617-1ab7-4a80-a928-ee0c99186f02", "content-length": "691", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
116142025-05-22T21:27:35.881ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
116152025-05-22T21:27:35.881ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
116162025-05-22T21:27:35.881ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
116172025-05-22T21:27:35.882ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 796.804607ms iteration = 21 status = {}
116182025-05-22T21:27:35.889ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "8b61b171-64b2-46be-a425-0e966c216c15", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
116192025-05-22T21:27:35.889ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
116202025-05-22T21:27:35.890ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca054d80-6863-4938-880e-5dfb497d7677", "content-length": "26", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
116212025-05-22T21:27:35.890ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
116222025-05-22T21:27:35.891ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 805.557448ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:22:35.632669660Z"},{"operation":"list","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:22:35.638663770Z"},{"generation":1,"operation":"put_config","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:27:35.889661621Z"},{"operation":"list","target_sled":"cfb86abd-85e5-4869-9e83-7fe6eb951ca2","time":"2025-05-22T21:27:35.890134608Z"}]}
116232025-05-22T21:27:35.898ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116242025-05-22T21:27:35.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116252025-05-22T21:27:35.901ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116262025-05-22T21:27:35.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116272025-05-22T21:27:35.943ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116282025-05-22T21:27:35.948ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
116292025-05-22T21:27:35.948ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116302025-05-22T21:27:35.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116312025-05-22T21:27:35.950ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116322025-05-22T21:27:35.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116332025-05-22T21:27:35.952ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116342025-05-22T21:27:35.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116352025-05-22T21:27:35.986ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
116362025-05-22T21:27:35.986ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
116372025-05-22T21:27:35.988ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116382025-05-22T21:27:35.995ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
116392025-05-22T21:27:35.995ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116402025-05-22T21:27:35.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116412025-05-22T21:27:36.001ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116422025-05-22T21:27:36.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116432025-05-22T21:27:36.003ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116442025-05-22T21:27:36.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116452025-05-22T21:27:36.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116462025-05-22T21:27:36.006ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116472025-05-22T21:27:36.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116482025-05-22T21:27:36.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116492025-05-22T21:27:36.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116502025-05-22T21:27:36.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116512025-05-22T21:27:36.020ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116522025-05-22T21:27:36.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116532025-05-22T21:27:36.022ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116542025-05-22T21:27:36.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116552025-05-22T21:27:36.025ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116562025-05-22T21:27:36.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
116572025-05-22T21:27:36.029ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116582025-05-22T21:27:36.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116592025-05-22T21:27:36.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116602025-05-22T21:27:36.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116612025-05-22T21:27:36.032ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d5f6bf22-439f-4262-9e78-7e39610bbabd", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
116622025-05-22T21:27:36.032ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
116632025-05-22T21:27:36.032ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116642025-05-22T21:27:36.033ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9611f52-99f8-44c2-b1fd-7f89e0aee706", "content-length": "682", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
116652025-05-22T21:27:36.033ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116662025-05-22T21:27:36.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116672025-05-22T21:27:36.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116682025-05-22T21:27:36.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116692025-05-22T21:27:36.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116702025-05-22T21:27:36.038ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116712025-05-22T21:27:36.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116722025-05-22T21:27:36.039ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
116732025-05-22T21:27:36.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116742025-05-22T21:27:36.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116752025-05-22T21:27:36.042ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116762025-05-22T21:27:36.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116772025-05-22T21:27:36.044ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116782025-05-22T21:27:36.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116792025-05-22T21:27:36.046ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
116802025-05-22T21:27:36.046ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116812025-05-22T21:27:36.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116822025-05-22T21:27:36.049ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116832025-05-22T21:27:36.051ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
116842025-05-22T21:27:36.051ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116852025-05-22T21:27:36.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116862025-05-22T21:27:36.052ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
116872025-05-22T21:27:36.052ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 50e6c9d1-9783-4101-90ec-42677e0df110, kind: Service { id: f66420ec-966b-48f7-b801-7a5c00f44cf4 }, name: Name("external-dns-f66420ec-966b-48f7-b801-7a5c00f44cf4"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 169, 168])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 530604b8-c0fd-4256-a82c-6e08797ab6de, kind: Service { id: f1e76fec-ec67-4aad-8dad-0c46c9ec3a28 }, name: Name("external-dns-f1e76fec-ec67-4aad-8dad-0c46c9ec3a28"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 182, 136])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 634cb3a5-8390-4b1f-b312-af48ad43016f, kind: Service { id: 6dfe2786-b2ce-4ee1-955f-d45523cf5611 }, name: Name("nexus-6dfe2786-b2ce-4ee1-955f-d45523cf5611"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 225, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7233869f-5c09-4527-9d4f-e52a32997131, kind: Service { id: 018c135c-9fbf-4850-9314-edfb890f58ad }, name: Name("nexus-018c135c-9fbf-4850-9314-edfb890f58ad"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 128, 191])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bc8cd9ca-5d4d-411d-ac26-42e3d9368705, kind: Service { id: 548ef0f1-b45a-42d9-a620-b374dd0fb713 }, name: Name("nexus-548ef0f1-b45a-42d9-a620-b374dd0fb713"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 167, 113])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
116882025-05-22T21:27:36.052ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
116892025-05-22T21:27:36.053ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 967.307665ms iteration = 21 status = {}
116902025-05-22T21:27:36.109ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, time_created: 2025-05-22T21:17:45.513933Z, time_modified: 2025-05-22T21:17:45.513933Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(56094621696)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
116912025-05-22T21:27:36.109ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
116922025-05-22T21:27:36.139ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116932025-05-22T21:27:36.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116942025-05-22T21:27:36.142ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116952025-05-22T21:27:36.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116962025-05-22T21:27:36.143ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116972025-05-22T21:27:36.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
116982025-05-22T21:27:36.146ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
116992025-05-22T21:27:36.168ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "03f1f699-bc0c-4c75-948b-0e6046b4bb6e", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
117002025-05-22T21:27:36.171ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:495
117012025-05-22T21:27:36.171ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 1.085314231s
117022025-05-22T21:27:36.171ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 1.085325171s iteration = 3 status = {}
117032025-05-22T21:27:36.298ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c8d5011-44dc-4cff-b1dd-03170e4c1a13", "content-length": "31974", "date": "Thu, 22 May 2025 21:27:35 GMT"} })
117042025-05-22T21:27:36.300ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
117052025-05-22T21:27:36.300ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
117062025-05-22T21:27:36.300ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
117072025-05-22T21:27:36.301ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117082025-05-22T21:27:36.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117092025-05-22T21:27:36.303ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117102025-05-22T21:27:36.305ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
117112025-05-22T21:27:36.305ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
117122025-05-22T21:27:36.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
117132025-05-22T21:27:36.453ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = c10b31b2-664a-478e-938a-9f66e18c72bd file = nexus/db-queries/src/db/datastore/inventory.rs:1014
117142025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = c10b31b2-664a-478e-938a-9f66e18c72bd time_started = 2025-05-22 21:27:35.665092 UTC
117152025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
117162025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117172025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.367435439s iteration = 3 status = {"collection_id":"c10b31b2-664a-478e-938a-9f66e18c72bd","time_done":"2025-05-22 21:27:36.300019 UTC","time_started":"2025-05-22 21:27:35.665092 UTC"}
117182025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
117192025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117202025-05-22T21:27:36.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117212025-05-22T21:27:36.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117222025-05-22T21:27:36.455ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117232025-05-22T21:27:36.455ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117242025-05-22T21:27:36.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e53ca3b-bf44-4f89-ad67-53e058cad558 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117252025-05-22T21:27:36.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e53ca3b-bf44-4f89-ad67-53e058cad558 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117262025-05-22T21:27:36.458ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117272025-05-22T21:27:36.458ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117282025-05-22T21:27:36.458ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6e53ca3b-bf44-4f89-ad67-53e058cad558 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117292025-05-22T21:27:36.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117302025-05-22T21:27:36.459ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
117312025-05-22T21:27:36.459ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117322025-05-22T21:27:36.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117332025-05-22T21:27:36.460ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117342025-05-22T21:27:36.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117352025-05-22T21:27:36.462ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117362025-05-22T21:27:36.464ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117372025-05-22T21:27:36.464ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117382025-05-22T21:27:36.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117392025-05-22T21:27:36.574ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117402025-05-22T21:27:36.574ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 121.062432ms iteration = 24 status = {"physical_disks_added":0}
117412025-05-22T21:27:36.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117422025-05-22T21:27:36.599ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117432025-05-22T21:27:36.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117442025-05-22T21:27:36.600ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117452025-05-22T21:27:36.602ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
117462025-05-22T21:27:36.602ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117472025-05-22T21:27:36.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117482025-05-22T21:27:36.604ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117492025-05-22T21:27:36.606ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
117502025-05-22T21:27:36.606ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117512025-05-22T21:27:36.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117522025-05-22T21:27:36.608ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117532025-05-22T21:27:36.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117542025-05-22T21:27:36.610ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117552025-05-22T21:27:36.612ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
117562025-05-22T21:27:36.612ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117572025-05-22T21:27:36.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117582025-05-22T21:27:36.613ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117592025-05-22T21:27:36.615ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
117602025-05-22T21:27:36.615ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
117612025-05-22T21:27:36.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
117622025-05-22T21:27:36.617ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
117632025-05-22T21:27:36.617ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 163.797688ms iteration = 6 status = {"blueprint_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","inventory_collection_id":"c4defc85-8b62-43d7-9b1a-72ecbfb126b3","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
117642025-05-22T21:27:37.472ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a08b7e3-84ad-4bb5-a4c0-d65cbeb96a24 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117652025-05-22T21:27:37.473ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a08b7e3-84ad-4bb5-a4c0-d65cbeb96a24 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117662025-05-22T21:27:37.475ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9a08b7e3-84ad-4bb5-a4c0-d65cbeb96a24 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117672025-05-22T21:27:38.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 479 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 87771401-4b9f-4695-b343-762a2a4b540d response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
117682025-05-22T21:27:38.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2762ce7c-9f54-4df5-957f-cb84127501bb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117692025-05-22T21:27:38.488ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2762ce7c-9f54-4df5-957f-cb84127501bb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117702025-05-22T21:27:38.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2522 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2762ce7c-9f54-4df5-957f-cb84127501bb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117712025-05-22T21:27:39.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 885adf5f-71bb-4f87-ace0-db0c6e4a765c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117722025-05-22T21:27:39.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 885adf5f-71bb-4f87-ace0-db0c6e4a765c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117732025-05-22T21:27:39.506ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2463 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 885adf5f-71bb-4f87-ace0-db0c6e4a765c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117742025-05-22T21:27:40.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 02ebd7a5-5767-406d-bf98-a04ca7b266a7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117752025-05-22T21:27:40.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 02ebd7a5-5767-406d-bf98-a04ca7b266a7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117762025-05-22T21:27:40.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2195 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 02ebd7a5-5767-406d-bf98-a04ca7b266a7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117772025-05-22T21:27:41.536ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e748f1a2-c9e2-4cb2-b1eb-fdff5a9198a9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117782025-05-22T21:27:41.536ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e748f1a2-c9e2-4cb2-b1eb-fdff5a9198a9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117792025-05-22T21:27:41.539ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e748f1a2-c9e2-4cb2-b1eb-fdff5a9198a9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117802025-05-22T21:27:42.553ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f37fdd6a-5d4b-4d87-abc6-623752c63189 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117812025-05-22T21:27:42.553ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f37fdd6a-5d4b-4d87-abc6-623752c63189 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117822025-05-22T21:27:42.555ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2145 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f37fdd6a-5d4b-4d87-abc6-623752c63189 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117832025-05-22T21:27:43.568ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5456b3f4-b3ae-4c4c-9aa5-057329fd8086 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117842025-05-22T21:27:43.569ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5456b3f4-b3ae-4c4c-9aa5-057329fd8086 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117852025-05-22T21:27:43.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5456b3f4-b3ae-4c4c-9aa5-057329fd8086 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117862025-05-22T21:27:44.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb687147-05b7-4d33-9ecd-bb07a90e299c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117872025-05-22T21:27:44.585ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb687147-05b7-4d33-9ecd-bb07a90e299c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117882025-05-22T21:27:44.587ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bb687147-05b7-4d33-9ecd-bb07a90e299c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
117892025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
117902025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
117912025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117922025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117932025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117942025-05-22T21:27:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117952025-05-22T21:27:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117962025-05-22T21:27:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117972025-05-22T21:27:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117982025-05-22T21:27:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117992025-05-22T21:27:45.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118002025-05-22T21:27:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118012025-05-22T21:27:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118022025-05-22T21:27:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
118032025-05-22T21:27:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118042025-05-22T21:27:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118052025-05-22T21:27:45.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
118062025-05-22T21:27:45.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.784168ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
118072025-05-22T21:27:45.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118082025-05-22T21:27:45.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118092025-05-22T21:27:45.148ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.231101ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118102025-05-22T21:27:45.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8cb73b87-0010-4a5a-9007-c0e7c619ac37 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118112025-05-22T21:27:45.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8cb73b87-0010-4a5a-9007-c0e7c619ac37 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118122025-05-22T21:27:45.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2272 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8cb73b87-0010-4a5a-9007-c0e7c619ac37 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118132025-05-22T21:27:46.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f45dc0e-8e86-4cc6-87fc-f11b739e6e8f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118142025-05-22T21:27:46.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f45dc0e-8e86-4cc6-87fc-f11b739e6e8f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118152025-05-22T21:27:46.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f45dc0e-8e86-4cc6-87fc-f11b739e6e8f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118162025-05-22T21:27:47.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e64da17-480d-42c0-a807-92fb657e1a0a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118172025-05-22T21:27:47.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e64da17-480d-42c0-a807-92fb657e1a0a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118182025-05-22T21:27:47.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2612 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4e64da17-480d-42c0-a807-92fb657e1a0a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118192025-05-22T21:27:48.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 597 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = bf139407-772f-456a-9da3-9514c2b5da05 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
118202025-05-22T21:27:48.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c505f19b-4797-4a45-a1e1-c0f80538c57f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118212025-05-22T21:27:48.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c505f19b-4797-4a45-a1e1-c0f80538c57f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118222025-05-22T21:27:48.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c505f19b-4797-4a45-a1e1-c0f80538c57f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118232025-05-22T21:27:49.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 030d587e-d24b-496f-bc78-c9bb4abc2bea roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118242025-05-22T21:27:49.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 030d587e-d24b-496f-bc78-c9bb4abc2bea resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118252025-05-22T21:27:49.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 030d587e-d24b-496f-bc78-c9bb4abc2bea response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118262025-05-22T21:27:50.679ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6927e4b5-588b-4a66-a5b7-f2dfcb27fe58 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118272025-05-22T21:27:50.679ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6927e4b5-588b-4a66-a5b7-f2dfcb27fe58 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118282025-05-22T21:27:50.681ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6927e4b5-588b-4a66-a5b7-f2dfcb27fe58 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118292025-05-22T21:27:51.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f526f813-b984-443d-9594-5dc12bf7e593 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118302025-05-22T21:27:51.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f526f813-b984-443d-9594-5dc12bf7e593 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118312025-05-22T21:27:51.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2104 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f526f813-b984-443d-9594-5dc12bf7e593 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118322025-05-22T21:27:52.710ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06250ee3-c8ab-4ce7-9749-5dcd1f08a598 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118332025-05-22T21:27:52.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06250ee3-c8ab-4ce7-9749-5dcd1f08a598 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118342025-05-22T21:27:52.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06250ee3-c8ab-4ce7-9749-5dcd1f08a598 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118352025-05-22T21:27:53.725ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e6d5cd6-37bb-4106-8c4f-0c32d9358fc8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118362025-05-22T21:27:53.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e6d5cd6-37bb-4106-8c4f-0c32d9358fc8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118372025-05-22T21:27:53.727ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2100 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e6d5cd6-37bb-4106-8c4f-0c32d9358fc8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118382025-05-22T21:27:54.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9fcf5e2-4336-4467-be06-51d925adb6c4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118392025-05-22T21:27:54.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9fcf5e2-4336-4467-be06-51d925adb6c4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118402025-05-22T21:27:54.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2335 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c9fcf5e2-4336-4467-be06-51d925adb6c4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118412025-05-22T21:27:55.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
118422025-05-22T21:27:55.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118432025-05-22T21:27:55.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
118442025-05-22T21:27:55.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118452025-05-22T21:27:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118462025-05-22T21:27:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118472025-05-22T21:27:55.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118482025-05-22T21:27:55.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118492025-05-22T21:27:55.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118502025-05-22T21:27:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118512025-05-22T21:27:55.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118522025-05-22T21:27:55.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118532025-05-22T21:27:55.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118542025-05-22T21:27:55.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118552025-05-22T21:27:55.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118562025-05-22T21:27:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
118572025-05-22T21:27:55.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118582025-05-22T21:27:55.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118592025-05-22T21:27:55.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
118602025-05-22T21:27:55.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.735573ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
118612025-05-22T21:27:55.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.995056ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118622025-05-22T21:27:55.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81556599-25e2-4d30-bb3f-e84943f1e5e3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118632025-05-22T21:27:55.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81556599-25e2-4d30-bb3f-e84943f1e5e3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118642025-05-22T21:27:55.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1563 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 81556599-25e2-4d30-bb3f-e84943f1e5e3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118652025-05-22T21:27:56.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0c714ce2-be3f-4c43-88e7-ac7690ea1932 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118662025-05-22T21:27:56.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0c714ce2-be3f-4c43-88e7-ac7690ea1932 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118672025-05-22T21:27:56.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2046 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0c714ce2-be3f-4c43-88e7-ac7690ea1932 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118682025-05-22T21:27:57.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0cc324fc-d018-441f-9563-e12375de177e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118692025-05-22T21:27:57.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0cc324fc-d018-441f-9563-e12375de177e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118702025-05-22T21:27:57.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0cc324fc-d018-441f-9563-e12375de177e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118712025-05-22T21:27:58.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 526 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = d6d0266d-007e-439c-aa2b-2a7cf1b351e7 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
118722025-05-22T21:27:58.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a421e1b-6fa7-4083-a929-64f753e7f6cf roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118732025-05-22T21:27:58.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a421e1b-6fa7-4083-a929-64f753e7f6cf resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118742025-05-22T21:27:58.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2599 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a421e1b-6fa7-4083-a929-64f753e7f6cf response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118752025-05-22T21:27:59.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0560ffd2-9e90-40b0-94a3-c08f1dffb2dc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118762025-05-22T21:27:59.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0560ffd2-9e90-40b0-94a3-c08f1dffb2dc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118772025-05-22T21:27:59.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0560ffd2-9e90-40b0-94a3-c08f1dffb2dc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118782025-05-22T21:28:00.832ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4842e7d5-47da-419c-97c7-14ab655f4ffa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118792025-05-22T21:28:00.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4842e7d5-47da-419c-97c7-14ab655f4ffa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118802025-05-22T21:28:00.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1536 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 4842e7d5-47da-419c-97c7-14ab655f4ffa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118812025-05-22T21:28:01.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 270082a3-c1b7-442d-bb38-c3da242f9a9a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118822025-05-22T21:28:01.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 270082a3-c1b7-442d-bb38-c3da242f9a9a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118832025-05-22T21:28:01.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2178 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 270082a3-c1b7-442d-bb38-c3da242f9a9a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118842025-05-22T21:28:02.862ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673a769c-19c8-495d-b54b-b7a253b729ba roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118852025-05-22T21:28:02.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673a769c-19c8-495d-b54b-b7a253b729ba resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118862025-05-22T21:28:02.864ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673a769c-19c8-495d-b54b-b7a253b729ba response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118872025-05-22T21:28:03.153ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:54501
118882025-05-22T21:28:03.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = fc3e6c64-cf37-4a46-9b0d-f9a3e085b61b roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
118892025-05-22T21:28:03.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = fc3e6c64-cf37-4a46-9b0d-f9a3e085b61b resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
118902025-05-22T21:28:03.157ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3684 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = fc3e6c64-cf37-4a46-9b0d-f9a3e085b61b response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?sort_by=id_ascending
118912025-05-22T21:28:03.157ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = e33fad2c-d53c-4c3e-b03c-c1bc46971a76 roles = RoleSet { roles: {} } uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
118922025-05-22T21:28:03.158ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = e33fad2c-d53c-4c3e-b03c-c1bc46971a76 resource = Database result = Ok(()) uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
118932025-05-22T21:28:03.159ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2117 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54501 req_id = e33fad2c-d53c-4c3e-b03c-c1bc46971a76 response_code = 200 uri = /metrics/collectors/5d686ed8-2833-474e-a52b-856ddeb711e7/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJjZmI4NmFiZC04NWU1LTQ4NjktOWU4My03ZmU2ZWI5NTFjYTIifX0%3D
118942025-05-22T21:28:03.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c827449c-268e-4499-852e-254be3e5da3e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118952025-05-22T21:28:03.877ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c827449c-268e-4499-852e-254be3e5da3e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118962025-05-22T21:28:03.879ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1568 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c827449c-268e-4499-852e-254be3e5da3e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118972025-05-22T21:28:04.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dcea1b5c-5411-4a43-9c4d-49a59b63b806 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118982025-05-22T21:28:04.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dcea1b5c-5411-4a43-9c4d-49a59b63b806 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
118992025-05-22T21:28:04.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dcea1b5c-5411-4a43-9c4d-49a59b63b806 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
119002025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
119012025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119022025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
119032025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
119042025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119052025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
119062025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
119072025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
119082025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
119092025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 22 reason = Timeout
119102025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119112025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119122025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
119132025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
119142025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119152025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
119162025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
119172025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
119182025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119192025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
119202025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
119212025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
119222025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
119232025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
119242025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
119252025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119262025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119272025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
119282025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
119292025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
119302025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
119312025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
119322025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 22 reason = Timeout
119332025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
119342025-05-22T21:28:05.085ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
119352025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119362025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
119372025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
119382025-05-22T21:28:05.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
119392025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
119402025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
119412025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
119422025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119432025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119442025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119452025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119462025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119472025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
119482025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
119492025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119502025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119512025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
119522025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
119532025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119542025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119552025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
119562025-05-22T21:28:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
119572025-05-22T21:28:05.089ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.429061ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
119582025-05-22T21:28:05.089ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 231979780 } })
119592025-05-22T21:28:05.089ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
119602025-05-22T21:28:05.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119612025-05-22T21:28:05.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119622025-05-22T21:28:05.092ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 235155478 } })
119632025-05-22T21:28:05.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
119642025-05-22T21:28:05.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
119652025-05-22T21:28:05.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
119662025-05-22T21:28:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
119672025-05-22T21:28:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
119682025-05-22T21:28:05.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119692025-05-22T21:28:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119702025-05-22T21:28:05.103ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119712025-05-22T21:28:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
119722025-05-22T21:28:05.107ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
119732025-05-22T21:28:05.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
119742025-05-22T21:28:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119752025-05-22T21:28:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119762025-05-22T21:28:05.132ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 46.419301ms iteration = 22 status = {"errors":[],"requests_created_ok":[]}
119772025-05-22T21:28:05.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
119782025-05-22T21:28:05.134ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
119792025-05-22T21:28:05.134ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119802025-05-22T21:28:05.134ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7395ee7-8135-4705-9541-8a1145e003b6", "content-length": "26", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
119812025-05-22T21:28:05.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
119822025-05-22T21:28:05.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119832025-05-22T21:28:05.136ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119842025-05-22T21:28:05.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 52.871277ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
119852025-05-22T21:28:05.138ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
119862025-05-22T21:28:05.138ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
119872025-05-22T21:28:05.139ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a2a3bca-4d27-41c7-889d-8f0c14087478", "content-length": "26", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
119882025-05-22T21:28:05.139ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
119892025-05-22T21:28:05.140ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
119902025-05-22T21:28:05.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119912025-05-22T21:28:05.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119922025-05-22T21:28:05.142ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119932025-05-22T21:28:05.144ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
119942025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
119952025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
119962025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
119972025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119982025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
119992025-05-22T21:28:05.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120002025-05-22T21:28:05.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 61.349123ms iteration = 22 status = {"errors":[],"finish_invoked_ok":[]}
120012025-05-22T21:28:05.149ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120022025-05-22T21:28:05.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120032025-05-22T21:28:05.150ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120042025-05-22T21:28:05.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120052025-05-22T21:28:05.151ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
120062025-05-22T21:28:05.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
120072025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120082025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120092025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120102025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120112025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120122025-05-22T21:28:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120132025-05-22T21:28:05.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
120142025-05-22T21:28:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
120152025-05-22T21:28:05.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120162025-05-22T21:28:05.154ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120172025-05-22T21:28:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120182025-05-22T21:28:05.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120192025-05-22T21:28:05.155ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120202025-05-22T21:28:05.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120212025-05-22T21:28:05.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120222025-05-22T21:28:05.156ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1594, tv_nsec: 299160960 } })
120232025-05-22T21:28:05.156ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
120242025-05-22T21:28:05.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120252025-05-22T21:28:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120262025-05-22T21:28:05.158ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
120272025-05-22T21:28:05.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120282025-05-22T21:28:05.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120292025-05-22T21:28:05.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
120302025-05-22T21:28:05.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120312025-05-22T21:28:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120322025-05-22T21:28:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
120332025-05-22T21:28:05.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120342025-05-22T21:28:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120352025-05-22T21:28:05.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120362025-05-22T21:28:05.162ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
120372025-05-22T21:28:05.162ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 76.741772ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
120382025-05-22T21:28:05.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120392025-05-22T21:28:05.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120402025-05-22T21:28:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
120412025-05-22T21:28:05.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120422025-05-22T21:28:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120432025-05-22T21:28:05.167ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.599754ms iteration = 22 status = 0
120442025-05-22T21:28:05.170ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
120452025-05-22T21:28:05.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
120462025-05-22T21:28:05.182ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.097165ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
120472025-05-22T21:28:05.188ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 102.561687ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120482025-05-22T21:28:05.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 103.311997ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
120492025-05-22T21:28:05.195ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120502025-05-22T21:28:05.195ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 110.005267ms iteration = 22 status = {}
120512025-05-22T21:28:05.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120522025-05-22T21:28:05.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 111.635521ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
120532025-05-22T21:28:05.198ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120542025-05-22T21:28:05.198ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
120552025-05-22T21:28:05.198ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120562025-05-22T21:28:05.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120572025-05-22T21:28:05.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120582025-05-22T21:28:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
120592025-05-22T21:28:05.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120602025-05-22T21:28:05.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120612025-05-22T21:28:05.214ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120622025-05-22T21:28:05.214ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
120632025-05-22T21:28:05.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 129.073329ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
120642025-05-22T21:28:05.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
120652025-05-22T21:28:05.218ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
120662025-05-22T21:28:05.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
120672025-05-22T21:28:05.233ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
120682025-05-22T21:28:05.233ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
120692025-05-22T21:28:05.233ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.226635ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
120702025-05-22T21:28:05.249ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120712025-05-22T21:28:05.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120722025-05-22T21:28:05.252ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 166.571138ms iteration = 22 status = null
120732025-05-22T21:28:05.258ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
120742025-05-22T21:28:05.258ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 172.549718ms iteration = 22 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
120752025-05-22T21:28:05.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
120762025-05-22T21:28:05.280ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
120772025-05-22T21:28:05.280ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "609968bc-2cf3-4c6b-a357-a89317949834", "content-length": "26", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
120782025-05-22T21:28:05.280ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
120792025-05-22T21:28:05.283ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
120802025-05-22T21:28:05.296ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
120812025-05-22T21:28:05.296ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
120822025-05-22T21:28:05.296ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d1d2b3-b085-45bd-b388-241f4668d96c", "content-length": "372", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
120832025-05-22T21:28:05.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120842025-05-22T21:28:05.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120852025-05-22T21:28:05.298ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.38714ms iteration = 25 status = {"physical_disks_added":0}
120862025-05-22T21:28:05.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120872025-05-22T21:28:05.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120882025-05-22T21:28:05.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120892025-05-22T21:28:05.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120902025-05-22T21:28:05.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120912025-05-22T21:28:05.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120922025-05-22T21:28:05.308ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120932025-05-22T21:28:05.311ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
120942025-05-22T21:28:05.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120952025-05-22T21:28:05.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120962025-05-22T21:28:05.345ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
120972025-05-22T21:28:05.345ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
120982025-05-22T21:28:05.345ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1635fa0b-d150-4689-a944-9671d9bde12d", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
120992025-05-22T21:28:05.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121002025-05-22T21:28:05.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121012025-05-22T21:28:05.348ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121022025-05-22T21:28:05.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121032025-05-22T21:28:05.351ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121042025-05-22T21:28:05.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121052025-05-22T21:28:05.354ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
121062025-05-22T21:28:05.354ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
121072025-05-22T21:28:05.355ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "023af7dd-c607-4da3-98d8-0479ac608811", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
121082025-05-22T21:28:05.356ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.118273ms iteration = 22 status = {}
121092025-05-22T21:28:05.387ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
121102025-05-22T21:28:05.387ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "89523a46-d1b9-4c7e-a9ba-fd0638b195db", "content-length": "691", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
121112025-05-22T21:28:05.387ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
121122025-05-22T21:28:05.387ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
121132025-05-22T21:28:05.387ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
121142025-05-22T21:28:05.390ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 304.955417ms iteration = 22 status = {}
121152025-05-22T21:28:05.426ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121162025-05-22T21:28:05.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121172025-05-22T21:28:05.429ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
121182025-05-22T21:28:05.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121192025-05-22T21:28:05.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121202025-05-22T21:28:05.440ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
121212025-05-22T21:28:05.440ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
121222025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
121232025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
121242025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121252025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121262025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121272025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121282025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
121292025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
121302025-05-22T21:28:05.441ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
121312025-05-22T21:28:05.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121322025-05-22T21:28:05.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121332025-05-22T21:28:05.444ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
121342025-05-22T21:28:05.444ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
121352025-05-22T21:28:05.629ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fbe31d11-d42b-436b-b7ce-ab2719e0b3b2", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
121362025-05-22T21:28:05.629ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
121372025-05-22T21:28:05.629ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
121382025-05-22T21:28:05.629ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ffcd83e-40d8-4561-b567-d63155dcdde2", "content-length": "682", "date": "Thu, 22 May 2025 21:28:05 GMT"} })
121392025-05-22T21:28:05.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121402025-05-22T21:28:05.630ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121412025-05-22T21:28:05.633ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121422025-05-22T21:28:05.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121432025-05-22T21:28:05.637ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121442025-05-22T21:28:05.637ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121452025-05-22T21:28:05.639ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121462025-05-22T21:28:05.639ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121472025-05-22T21:28:05.646ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 561.046649ms iteration = 22 status = {}
121482025-05-22T21:28:05.908ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5ee5e0e-cfd7-47be-8f97-56d3a44ca9b6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121492025-05-22T21:28:05.908ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5ee5e0e-cfd7-47be-8f97-56d3a44ca9b6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121502025-05-22T21:28:05.910ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5ee5e0e-cfd7-47be-8f97-56d3a44ca9b6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121512025-05-22T21:28:06.926ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0f9fe9ee-ec5e-4bb6-b46b-cd95b89b789d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121522025-05-22T21:28:06.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0f9fe9ee-ec5e-4bb6-b46b-cd95b89b789d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121532025-05-22T21:28:06.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1972 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0f9fe9ee-ec5e-4bb6-b46b-cd95b89b789d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121542025-05-22T21:28:07.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6664d474-9814-423e-8104-33ccd130424c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121552025-05-22T21:28:07.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6664d474-9814-423e-8104-33ccd130424c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121562025-05-22T21:28:07.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6664d474-9814-423e-8104-33ccd130424c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121572025-05-22T21:28:08.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 450 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 6e91aec5-d6df-46c6-ad40-c0ae00b8d0f7 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
121582025-05-22T21:28:08.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92abe77f-9a2d-43f4-9672-4e80d0999880 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121592025-05-22T21:28:08.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92abe77f-9a2d-43f4-9672-4e80d0999880 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121602025-05-22T21:28:08.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92abe77f-9a2d-43f4-9672-4e80d0999880 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121612025-05-22T21:28:09.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad0a743e-274a-4b8d-b6e7-136c78df27bb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121622025-05-22T21:28:09.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad0a743e-274a-4b8d-b6e7-136c78df27bb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121632025-05-22T21:28:09.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2146 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad0a743e-274a-4b8d-b6e7-136c78df27bb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121642025-05-22T21:28:10.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b947a4c-8c1e-40d5-849f-b147b0fc5483 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121652025-05-22T21:28:10.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b947a4c-8c1e-40d5-849f-b147b0fc5483 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121662025-05-22T21:28:10.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2022 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b947a4c-8c1e-40d5-849f-b147b0fc5483 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121672025-05-22T21:28:12.003ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fdcce33-d5ad-418d-bd17-47a4e9dd7811 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121682025-05-22T21:28:12.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fdcce33-d5ad-418d-bd17-47a4e9dd7811 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121692025-05-22T21:28:12.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2403 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8fdcce33-d5ad-418d-bd17-47a4e9dd7811 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121702025-05-22T21:28:13.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e208232b-6468-44d7-b28c-e13d6fb2d251 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121712025-05-22T21:28:13.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e208232b-6468-44d7-b28c-e13d6fb2d251 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121722025-05-22T21:28:13.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e208232b-6468-44d7-b28c-e13d6fb2d251 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121732025-05-22T21:28:14.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88b3804-f882-4684-ae25-3d1b66539ef3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121742025-05-22T21:28:14.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88b3804-f882-4684-ae25-3d1b66539ef3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121752025-05-22T21:28:14.038ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2278 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88b3804-f882-4684-ae25-3d1b66539ef3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121762025-05-22T21:28:15.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dab8c2d7-a55b-440d-bff5-ae3803f2dbfe roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121772025-05-22T21:28:15.052ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dab8c2d7-a55b-440d-bff5-ae3803f2dbfe resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121782025-05-22T21:28:15.054ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = dab8c2d7-a55b-440d-bff5-ae3803f2dbfe response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
121792025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
121802025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
121812025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121822025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121832025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121842025-05-22T21:28:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121852025-05-22T21:28:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121862025-05-22T21:28:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121872025-05-22T21:28:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121882025-05-22T21:28:15.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.04336ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
121892025-05-22T21:28:15.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121902025-05-22T21:28:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121912025-05-22T21:28:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121922025-05-22T21:28:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121932025-05-22T21:28:15.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121942025-05-22T21:28:15.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121952025-05-22T21:28:15.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
121962025-05-22T21:28:15.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121972025-05-22T21:28:15.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121982025-05-22T21:28:15.107ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
121992025-05-22T21:28:15.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.990728ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
122002025-05-22T21:28:16.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be963698-c496-4811-b486-6de24cf81f83 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122012025-05-22T21:28:16.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be963698-c496-4811-b486-6de24cf81f83 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122022025-05-22T21:28:16.069ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be963698-c496-4811-b486-6de24cf81f83 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122032025-05-22T21:28:17.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6785f2d-0022-431e-8ffb-2f9885a3d9ec roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122042025-05-22T21:28:17.084ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6785f2d-0022-431e-8ffb-2f9885a3d9ec resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122052025-05-22T21:28:17.086ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e6785f2d-0022-431e-8ffb-2f9885a3d9ec response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122062025-05-22T21:28:18.100ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d6213-377e-4e9c-9fd5-7d648272ecdd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122072025-05-22T21:28:18.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d6213-377e-4e9c-9fd5-7d648272ecdd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122082025-05-22T21:28:18.102ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2351 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee8d6213-377e-4e9c-9fd5-7d648272ecdd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122092025-05-22T21:28:18.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 96b0b85f-9aaa-49ab-9066-b34559c66f57 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
122102025-05-22T21:28:19.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6278bde-f8ec-4af5-9417-15ce7d4a8320 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122112025-05-22T21:28:19.115ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6278bde-f8ec-4af5-9417-15ce7d4a8320 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122122025-05-22T21:28:19.117ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2345 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a6278bde-f8ec-4af5-9417-15ce7d4a8320 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122132025-05-22T21:28:20.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2097e660-b99e-415f-b800-2191bdd883d8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122142025-05-22T21:28:20.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2097e660-b99e-415f-b800-2191bdd883d8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122152025-05-22T21:28:20.133ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2498 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2097e660-b99e-415f-b800-2191bdd883d8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122162025-05-22T21:28:21.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f54e4e25-2ea2-423f-a263-71323fa2e904 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122172025-05-22T21:28:21.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f54e4e25-2ea2-423f-a263-71323fa2e904 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122182025-05-22T21:28:21.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2328 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f54e4e25-2ea2-423f-a263-71323fa2e904 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122192025-05-22T21:28:22.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b00bdda-f3b3-46f9-81b1-57efb66be78f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122202025-05-22T21:28:22.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b00bdda-f3b3-46f9-81b1-57efb66be78f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122212025-05-22T21:28:22.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1549 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b00bdda-f3b3-46f9-81b1-57efb66be78f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122222025-05-22T21:28:23.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06d6ef70-99dd-4ce3-9b6a-ea58ab766bc0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122232025-05-22T21:28:23.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06d6ef70-99dd-4ce3-9b6a-ea58ab766bc0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122242025-05-22T21:28:23.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1981 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 06d6ef70-99dd-4ce3-9b6a-ea58ab766bc0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122252025-05-22T21:28:24.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f21d14e-e6d5-46df-ba3d-56f8618c4614 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122262025-05-22T21:28:24.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f21d14e-e6d5-46df-ba3d-56f8618c4614 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122272025-05-22T21:28:24.196ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6f21d14e-e6d5-46df-ba3d-56f8618c4614 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122282025-05-22T21:28:25.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
122292025-05-22T21:28:25.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
122302025-05-22T21:28:25.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122312025-05-22T21:28:25.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122322025-05-22T21:28:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122332025-05-22T21:28:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122342025-05-22T21:28:25.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122352025-05-22T21:28:25.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
122362025-05-22T21:28:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
122372025-05-22T21:28:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
122382025-05-22T21:28:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122392025-05-22T21:28:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122402025-05-22T21:28:25.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 6.139472ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122412025-05-22T21:28:25.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122422025-05-22T21:28:25.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122432025-05-22T21:28:25.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122442025-05-22T21:28:25.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
122452025-05-22T21:28:25.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122462025-05-22T21:28:25.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
122472025-05-22T21:28:25.105ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
122482025-05-22T21:28:25.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.422709ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
122492025-05-22T21:28:25.210ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cee58c76-644d-493f-bd66-0d5fa093a1a1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122502025-05-22T21:28:25.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cee58c76-644d-493f-bd66-0d5fa093a1a1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122512025-05-22T21:28:25.212ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cee58c76-644d-493f-bd66-0d5fa093a1a1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122522025-05-22T21:28:26.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5161145-6479-41d1-8630-478408ee449f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122532025-05-22T21:28:26.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5161145-6479-41d1-8630-478408ee449f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122542025-05-22T21:28:26.229ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2003 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c5161145-6479-41d1-8630-478408ee449f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122552025-05-22T21:28:27.245ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76d9fcdb-d3a2-4ef8-a9ab-c0fceb8990ec roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122562025-05-22T21:28:27.245ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76d9fcdb-d3a2-4ef8-a9ab-c0fceb8990ec resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122572025-05-22T21:28:27.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2425 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 76d9fcdb-d3a2-4ef8-a9ab-c0fceb8990ec response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122582025-05-22T21:28:28.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 537 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 6a889965-9508-40e1-aada-f0d4afd75675 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
122592025-05-22T21:28:28.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad8d4521-c86e-4c0c-adcf-344fd60e3226 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122602025-05-22T21:28:28.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad8d4521-c86e-4c0c-adcf-344fd60e3226 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122612025-05-22T21:28:28.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2579 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ad8d4521-c86e-4c0c-adcf-344fd60e3226 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122622025-05-22T21:28:29.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ad3a9c4-6dea-40e9-ae10-b9244d83581d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122632025-05-22T21:28:29.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ad3a9c4-6dea-40e9-ae10-b9244d83581d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122642025-05-22T21:28:29.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2096 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ad3a9c4-6dea-40e9-ae10-b9244d83581d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122652025-05-22T21:28:30.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a10e03a-074e-4b53-acfe-b8996a6164d2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122662025-05-22T21:28:30.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a10e03a-074e-4b53-acfe-b8996a6164d2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122672025-05-22T21:28:30.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a10e03a-074e-4b53-acfe-b8996a6164d2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122682025-05-22T21:28:31.311ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 393bffee-2e3f-4137-aff0-31ea9ae8d880 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122692025-05-22T21:28:31.311ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 393bffee-2e3f-4137-aff0-31ea9ae8d880 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122702025-05-22T21:28:31.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1818 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 393bffee-2e3f-4137-aff0-31ea9ae8d880 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122712025-05-22T21:28:32.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92113f9e-16ab-45fe-aafd-b47dcde91e8f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122722025-05-22T21:28:32.328ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92113f9e-16ab-45fe-aafd-b47dcde91e8f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122732025-05-22T21:28:32.329ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92113f9e-16ab-45fe-aafd-b47dcde91e8f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122742025-05-22T21:28:33.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab59ecef-671b-43a9-93b2-00ce924c8862 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122752025-05-22T21:28:33.344ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab59ecef-671b-43a9-93b2-00ce924c8862 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122762025-05-22T21:28:33.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1967 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ab59ecef-671b-43a9-93b2-00ce924c8862 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122772025-05-22T21:28:34.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 576260d4-1c4b-4437-b4fd-d5180fe9f114 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122782025-05-22T21:28:34.360ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 576260d4-1c4b-4437-b4fd-d5180fe9f114 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122792025-05-22T21:28:34.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2791 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 576260d4-1c4b-4437-b4fd-d5180fe9f114 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
122802025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
122812025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 23 reason = Timeout
122822025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
122832025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
122842025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
122852025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
122862025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
122872025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
122882025-05-22T21:28:35.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
122892025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122902025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
122912025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
122922025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
122932025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
122942025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
122952025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122962025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
122972025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
122982025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
122992025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
123002025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
123012025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123022025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
123032025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123042025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
123052025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
123062025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
123072025-05-22T21:28:35.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
123082025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 12 reason = Timeout
123092025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123102025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
123112025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
123122025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
123132025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
123142025-05-22T21:28:35.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:18:35.086197828 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
123152025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
123162025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
123172025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
123182025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
123192025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
123202025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 23 reason = Timeout
123212025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
123222025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
123232025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
123242025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
123252025-05-22T21:28:35.086ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
123262025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.13\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
123272025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
123282025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
123292025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
123302025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
123312025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
123322025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
123332025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
123342025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
123352025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
123362025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
123372025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
123382025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
123392025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123402025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
123412025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
123422025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
123432025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
123442025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
123452025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
123462025-05-22T21:28:35.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
123472025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
123482025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
123492025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
123502025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123512025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123522025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
123532025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123542025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123552025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
123562025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
123572025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
123582025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
123592025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123602025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123612025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
123622025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
123632025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
123642025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
123652025-05-22T21:28:35.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
123662025-05-22T21:28:35.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 229547822 } })
123672025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
123682025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
123692025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123702025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
123712025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
123722025-05-22T21:28:35.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 229596903 } })
123732025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
123742025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 12 reason = Timeout
123752025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
123762025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
123772025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
123782025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
123792025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
123802025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.176858ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
123812025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
123822025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
123832025-05-22T21:28:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.34234ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
123842025-05-22T21:28:35.092ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.515942ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
123852025-05-22T21:28:35.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123862025-05-22T21:28:35.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123872025-05-22T21:28:35.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123882025-05-22T21:28:35.097ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123892025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123902025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
123912025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
123922025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
123932025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
123942025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
123952025-05-22T21:28:35.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
123962025-05-22T21:28:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
123972025-05-22T21:28:35.101ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123982025-05-22T21:28:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123992025-05-22T21:28:35.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124002025-05-22T21:28:35.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124012025-05-22T21:28:35.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 249746963 } })
124022025-05-22T21:28:35.107ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
124032025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124042025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124052025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
124062025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124072025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124082025-05-22T21:28:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124092025-05-22T21:28:35.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124102025-05-22T21:28:35.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124112025-05-22T21:28:35.111ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124122025-05-22T21:28:35.111ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:18:35.086197828 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
124132025-05-22T21:28:35.111ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 25.050543ms iteration = 12 status = {"expiration":"2025-05-22T21:18:35.086197828Z","pruned":[]}
124142025-05-22T21:28:35.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124152025-05-22T21:28:35.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124162025-05-22T21:28:35.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 26.94555ms iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
124172025-05-22T21:28:35.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
124182025-05-22T21:28:35.115ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124192025-05-22T21:28:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124202025-05-22T21:28:35.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
124212025-05-22T21:28:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
124222025-05-22T21:28:35.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
124232025-05-22T21:28:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
124242025-05-22T21:28:35.117ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
124252025-05-22T21:28:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
124262025-05-22T21:28:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
124272025-05-22T21:28:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124282025-05-22T21:28:35.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124292025-05-22T21:28:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124302025-05-22T21:28:35.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124312025-05-22T21:28:35.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124322025-05-22T21:28:35.122ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 35.748492ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
124332025-05-22T21:28:35.122ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124342025-05-22T21:28:35.123ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
124352025-05-22T21:28:35.123ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 36.849689ms iteration = 12 status = {"by_rx":{},"error":null}
124362025-05-22T21:28:35.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 268011795 } })
124372025-05-22T21:28:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
124382025-05-22T21:28:35.125ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
124392025-05-22T21:28:35.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124402025-05-22T21:28:35.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
124412025-05-22T21:28:35.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
124422025-05-22T21:28:35.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124432025-05-22T21:28:35.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124442025-05-22T21:28:35.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124452025-05-22T21:28:35.130ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124462025-05-22T21:28:35.130ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
124472025-05-22T21:28:35.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
124482025-05-22T21:28:35.131ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1624, tv_nsec: 274038884 } })
124492025-05-22T21:28:35.131ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
124502025-05-22T21:28:35.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124512025-05-22T21:28:35.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124522025-05-22T21:28:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124532025-05-22T21:28:35.134ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124542025-05-22T21:28:35.134ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124552025-05-22T21:28:35.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124562025-05-22T21:28:35.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
124572025-05-22T21:28:35.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124582025-05-22T21:28:35.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124592025-05-22T21:28:35.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124602025-05-22T21:28:35.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124612025-05-22T21:28:35.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124622025-05-22T21:28:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124632025-05-22T21:28:35.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124642025-05-22T21:28:35.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124652025-05-22T21:28:35.157ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124662025-05-22T21:28:35.161ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 75.24354ms iteration = 12 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
124672025-05-22T21:28:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
124682025-05-22T21:28:35.163ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
124692025-05-22T21:28:35.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
124702025-05-22T21:28:35.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124712025-05-22T21:28:35.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.809153ms iteration = 23 status = {"errors":[],"finish_invoked_ok":[]}
124722025-05-22T21:28:35.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
124732025-05-22T21:28:35.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124742025-05-22T21:28:35.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124752025-05-22T21:28:35.172ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
124762025-05-22T21:28:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
124772025-05-22T21:28:35.190ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
124782025-05-22T21:28:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
124792025-05-22T21:28:35.191ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 105.554771ms iteration = 23 status = {"errors":[],"requests_created_ok":[]}
124802025-05-22T21:28:35.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 106.422933ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124812025-05-22T21:28:35.193ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
124822025-05-22T21:28:35.193ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
124832025-05-22T21:28:35.194ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124842025-05-22T21:28:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124852025-05-22T21:28:35.198ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
124862025-05-22T21:28:35.198ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
124872025-05-22T21:28:35.198ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 112.167118ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
124882025-05-22T21:28:35.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.966775ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
124892025-05-22T21:28:35.205ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124902025-05-22T21:28:35.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124912025-05-22T21:28:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124922025-05-22T21:28:35.211ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
124932025-05-22T21:28:35.215ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
124942025-05-22T21:28:35.215ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
124952025-05-22T21:28:35.215ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 128.974429ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
124962025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
124972025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
124982025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
124992025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
125002025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
125012025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
125022025-05-22T21:28:35.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
125032025-05-22T21:28:35.263ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
125042025-05-22T21:28:35.264ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
125052025-05-22T21:28:35.264ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
125062025-05-22T21:28:35.265ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
125072025-05-22T21:28:35.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125082025-05-22T21:28:35.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125092025-05-22T21:28:35.281ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
125102025-05-22T21:28:35.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
125112025-05-22T21:28:35.289ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
125122025-05-22T21:28:35.346ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
125132025-05-22T21:28:35.346ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125142025-05-22T21:28:35.346ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0acda299-291b-4c54-a002-307a53cca9d4", "content-length": "26", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
125152025-05-22T21:28:35.346ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125162025-05-22T21:28:35.348ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125172025-05-22T21:28:35.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
125182025-05-22T21:28:35.357ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125192025-05-22T21:28:35.357ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8da23ab5-9951-4d4e-9f8c-fe4c883395d0", "content-length": "26", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
125202025-05-22T21:28:35.357ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125212025-05-22T21:28:35.359ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125222025-05-22T21:28:35.359ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125232025-05-22T21:28:35.360ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f35fde4-c9f2-4a84-b7fa-b3ee0cabcebf", "content-length": "523", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
125242025-05-22T21:28:35.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125252025-05-22T21:28:35.360ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125262025-05-22T21:28:35.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125272025-05-22T21:28:35.362ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125282025-05-22T21:28:35.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125292025-05-22T21:28:35.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125302025-05-22T21:28:35.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125312025-05-22T21:28:35.376ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
125322025-05-22T21:28:35.376ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 290.774186ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
125332025-05-22T21:28:35.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d53bed3-6492-4069-bc15-073bc4ef25e7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
125342025-05-22T21:28:35.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d53bed3-6492-4069-bc15-073bc4ef25e7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
125352025-05-22T21:28:35.400ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8/state
125362025-05-22T21:28:35.405ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125372025-05-22T21:28:35.409ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
125382025-05-22T21:28:35.409ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
125392025-05-22T21:28:35.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
125402025-05-22T21:28:35.411ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
125412025-05-22T21:28:35.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
125422025-05-22T21:28:35.414ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125432025-05-22T21:28:35.414ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125442025-05-22T21:28:35.414ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125452025-05-22T21:28:35.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 37753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d53bed3-6492-4069-bc15-073bc4ef25e7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
125462025-05-22T21:28:35.415ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125472025-05-22T21:28:35.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125482025-05-22T21:28:35.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125492025-05-22T21:28:35.418ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125502025-05-22T21:28:35.419ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
125512025-05-22T21:28:35.419ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125522025-05-22T21:28:35.419ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51c4c8e1-fdfe-4673-ba4a-528aa001eba8", "content-length": "26", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
125532025-05-22T21:28:35.419ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125542025-05-22T21:28:35.421ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
125552025-05-22T21:28:35.421ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125562025-05-22T21:28:35.422ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125572025-05-22T21:28:35.422ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
125582025-05-22T21:28:35.424ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 338.353564ms iteration = 23 status = 0
125592025-05-22T21:28:35.446ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125602025-05-22T21:28:35.447ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 361.175364ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125612025-05-22T21:28:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
125622025-05-22T21:28:35.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
125632025-05-22T21:28:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
125642025-05-22T21:28:35.457ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
125652025-05-22T21:28:35.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
125662025-05-22T21:28:35.463ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125672025-05-22T21:28:35.465ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
125682025-05-22T21:28:35.465ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
125692025-05-22T21:28:35.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
125702025-05-22T21:28:35.467ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125712025-05-22T21:28:35.467ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
125722025-05-22T21:28:35.467ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 381.383585ms iteration = 23 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
125732025-05-22T21:28:35.468ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125742025-05-22T21:28:35.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125752025-05-22T21:28:35.471ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125762025-05-22T21:28:35.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125772025-05-22T21:28:35.471ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125782025-05-22T21:28:35.471ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 385.366335ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125792025-05-22T21:28:35.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125802025-05-22T21:28:35.472ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
125812025-05-22T21:28:35.472ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
125822025-05-22T21:28:35.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
125832025-05-22T21:28:35.487ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {d5b80cc5-578a-429f-92b0-7ead62103416: {10.151.2.175: {1b877ecc-3748-447a-97cb-f1086046d343}, 10.151.2.176: {1b877ecc-3748-447a-97cb-f1086046d343}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
125842025-05-22T21:28:35.487ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125852025-05-22T21:28:35.487ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff46614c-4487-4b6a-84e3-6f29276f007c", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
125862025-05-22T21:28:35.488ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125872025-05-22T21:28:35.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125882025-05-22T21:28:35.490ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
125892025-05-22T21:28:35.490ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125902025-05-22T21:28:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125912025-05-22T21:28:35.491ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
125922025-05-22T21:28:35.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "74d93ef7-863f-4169-a94d-e1e13970e7b0", "date": "Thu, 22 May 2025 21:28:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
125932025-05-22T21:28:35.491ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
125942025-05-22T21:28:35.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "5c0b35bd-f383-4feb-bef8-55d580c4c689", "date": "Thu, 22 May 2025 21:28:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
125952025-05-22T21:28:35.493ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
125962025-05-22T21:28:35.493ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125972025-05-22T21:28:35.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125982025-05-22T21:28:35.498ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
125992025-05-22T21:28:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 411.894498ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
126002025-05-22T21:28:35.499ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126012025-05-22T21:28:35.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126022025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126032025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
126042025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
126052025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126062025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 416.485158ms iteration = 23 status = null
126072025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126082025-05-22T21:28:35.502ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126092025-05-22T21:28:35.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126102025-05-22T21:28:35.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126112025-05-22T21:28:35.510ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 424.454856ms iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
126122025-05-22T21:28:35.514ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126132025-05-22T21:28:35.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126142025-05-22T21:28:35.520ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
126152025-05-22T21:28:35.520ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126162025-05-22T21:28:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126172025-05-22T21:28:35.523ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126182025-05-22T21:28:35.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126192025-05-22T21:28:35.531ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126202025-05-22T21:28:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126212025-05-22T21:28:35.532ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 446.441213ms iteration = 26 status = {"physical_disks_added":0}
126222025-05-22T21:28:35.533ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126232025-05-22T21:28:35.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126242025-05-22T21:28:35.536ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
126252025-05-22T21:28:35.536ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 450.638815ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
126262025-05-22T21:28:35.540ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
126272025-05-22T21:28:35.540ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
126282025-05-22T21:28:35.540ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126292025-05-22T21:28:35.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126302025-05-22T21:28:35.542ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126312025-05-22T21:28:35.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126322025-05-22T21:28:35.545ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 459.164683ms iteration = 23 status = {}
126332025-05-22T21:28:35.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126342025-05-22T21:28:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
126352025-05-22T21:28:35.568ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
126362025-05-22T21:28:35.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
126372025-05-22T21:28:35.572ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
126382025-05-22T21:28:35.572ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
126392025-05-22T21:28:35.572ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
126402025-05-22T21:28:35.572ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 486.394278ms iteration = 12 status = {"generation":1}
126412025-05-22T21:28:35.579ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
126422025-05-22T21:28:35.580ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "52a569b3-fc15-4b51-b42b-de77b2570edd", "date": "Thu, 22 May 2025 21:28:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126432025-05-22T21:28:35.580ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126442025-05-22T21:28:35.582ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3915d3e2-1cd7-4d2f-b4ae-fa1e9f7b0be8", "date": "Thu, 22 May 2025 21:28:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126452025-05-22T21:28:35.582ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126462025-05-22T21:28:35.585ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b762c24e-ea12-4adb-b12e-f4b591f12cf5", "date": "Thu, 22 May 2025 21:28:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126472025-05-22T21:28:35.585ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126482025-05-22T21:28:35.588ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
126492025-05-22T21:28:35.588ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 502.372335ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
126502025-05-22T21:28:35.595ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126512025-05-22T21:28:35.603ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
126522025-05-22T21:28:35.603ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
126532025-05-22T21:28:35.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
126542025-05-22T21:28:35.606ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
126552025-05-22T21:28:35.606ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
126562025-05-22T21:28:35.606ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
126572025-05-22T21:28:35.606ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 519.841626ms iteration = 12 status = {"generation":2}
126582025-05-22T21:28:35.611ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126592025-05-22T21:28:35.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126602025-05-22T21:28:35.620ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
126612025-05-22T21:28:35.620ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 533.693291ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
126622025-05-22T21:28:35.655ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
126632025-05-22T21:28:35.655ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "988601de-11fe-41a1-95af-596247028feb", "content-length": "810", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
126642025-05-22T21:28:35.655ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(5001411) }} sled = sock
126652025-05-22T21:28:35.655ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
126662025-05-22T21:28:35.655ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
126672025-05-22T21:28:35.658ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 572.933785ms iteration = 23 status = {}
126682025-05-22T21:28:35.661ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126692025-05-22T21:28:35.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126702025-05-22T21:28:35.674ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126712025-05-22T21:28:35.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126722025-05-22T21:28:35.676ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
126732025-05-22T21:28:35.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126742025-05-22T21:28:35.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126752025-05-22T21:28:35.692ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126762025-05-22T21:28:35.692ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
126772025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126782025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126792025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126802025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126812025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126822025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126832025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126842025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126852025-05-22T21:28:35.693ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
126862025-05-22T21:28:35.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126872025-05-22T21:28:35.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126882025-05-22T21:28:35.696ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
126892025-05-22T21:28:35.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126902025-05-22T21:28:35.707ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126912025-05-22T21:28:35.712ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: eaf3754c-f221-44fd-8dda-f534dc288d73, lookup_type: ById(eaf3754c-f221-44fd-8dda-f534dc288d73) }, key: 3d3d9c96-422e-496f-96c1-d3ffea30de6c, lookup_type: ById(3d3d9c96-422e-496f-96c1-d3ffea30de6c) } result = Ok(())
126922025-05-22T21:28:35.712ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126932025-05-22T21:28:35.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126942025-05-22T21:28:35.715ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126952025-05-22T21:28:35.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126962025-05-22T21:28:35.716ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
126972025-05-22T21:28:35.717ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
126982025-05-22T21:28:35.719ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126992025-05-22T21:28:35.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: eaf3754c-f221-44fd-8dda-f534dc288d73, lookup_type: ById(eaf3754c-f221-44fd-8dda-f534dc288d73) }, key: 3d3d9c96-422e-496f-96c1-d3ffea30de6c, lookup_type: ById(3d3d9c96-422e-496f-96c1-d3ffea30de6c) } result = Ok(())
127002025-05-22T21:28:35.724ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127012025-05-22T21:28:35.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127022025-05-22T21:28:35.838ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127032025-05-22T21:28:35.838ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127042025-05-22T21:28:35.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127052025-05-22T21:28:35.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127062025-05-22T21:28:35.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127072025-05-22T21:28:35.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127082025-05-22T21:28:35.848ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127092025-05-22T21:28:35.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127102025-05-22T21:28:35.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127112025-05-22T21:28:35.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127122025-05-22T21:28:35.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127132025-05-22T21:28:35.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127142025-05-22T21:28:35.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127152025-05-22T21:28:35.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127162025-05-22T21:28:35.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127172025-05-22T21:28:35.861ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: eaf3754c-f221-44fd-8dda-f534dc288d73, lookup_type: ById(eaf3754c-f221-44fd-8dda-f534dc288d73) }, key: 12ead00a-0120-4298-84c4-84a0520c6b1e, lookup_type: ById(12ead00a-0120-4298-84c4-84a0520c6b1e) } result = Ok(())
127182025-05-22T21:28:35.861ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127192025-05-22T21:28:35.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127202025-05-22T21:28:35.866ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127212025-05-22T21:28:35.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127222025-05-22T21:28:35.868ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127232025-05-22T21:28:35.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127242025-05-22T21:28:35.870ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127252025-05-22T21:28:35.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127262025-05-22T21:28:35.872ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127272025-05-22T21:28:35.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127282025-05-22T21:28:35.874ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127292025-05-22T21:28:35.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127302025-05-22T21:28:35.876ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127312025-05-22T21:28:35.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127322025-05-22T21:28:35.878ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127332025-05-22T21:28:35.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: eaf3754c-f221-44fd-8dda-f534dc288d73, lookup_type: ById(eaf3754c-f221-44fd-8dda-f534dc288d73) }, key: 12ead00a-0120-4298-84c4-84a0520c6b1e, lookup_type: ByName("default") } result = Ok(())
127342025-05-22T21:28:35.882ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127352025-05-22T21:28:35.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127362025-05-22T21:28:35.885ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127372025-05-22T21:28:35.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127382025-05-22T21:28:35.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127392025-05-22T21:28:35.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127402025-05-22T21:28:35.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127412025-05-22T21:28:35.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127422025-05-22T21:28:35.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127432025-05-22T21:28:35.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127442025-05-22T21:28:35.894ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127452025-05-22T21:28:35.894ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127462025-05-22T21:28:35.896ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127472025-05-22T21:28:35.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127482025-05-22T21:28:35.897ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127492025-05-22T21:28:35.902ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: eaf3754c-f221-44fd-8dda-f534dc288d73, lookup_type: ById(eaf3754c-f221-44fd-8dda-f534dc288d73) }, key: 1b877ecc-3748-447a-97cb-f1086046d343, lookup_type: ByName("default") } result = Ok(())
127502025-05-22T21:28:35.911ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
127512025-05-22T21:28:35.912ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79404623-94ce-40dc-9830-ee5104e5e7c1", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
127522025-05-22T21:28:35.913ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 827.748658ms iteration = 23 status = {}
127532025-05-22T21:28:35.977ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d74d87c9-120b-4c77-a2db-f691619fc586", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
127542025-05-22T21:28:35.977ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
127552025-05-22T21:28:35.978ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
127562025-05-22T21:28:35.978ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a74f5ea-9c9c-40ee-9338-e2d987977e49", "content-length": "682", "date": "Thu, 22 May 2025 21:28:35 GMT"} })
127572025-05-22T21:28:35.978ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127582025-05-22T21:28:35.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127592025-05-22T21:28:35.990ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127602025-05-22T21:28:35.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127612025-05-22T21:28:35.995ZDEBGnexus (producer-registration-task): registering as oximeter producer with Nexus registration_count = 4
127622025-05-22T21:28:35.995ZDEBGnexus (producer-registration-task): will register with Nexus at [fd00:1122:3344:101::b]:12221
127632025-05-22T21:28:36.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127642025-05-22T21:28:36.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127652025-05-22T21:28:36.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127662025-05-22T21:28:36.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127672025-05-22T21:28:36.035ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 949.300666ms iteration = 23 status = {}
127682025-05-22T21:28:36.067ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
127692025-05-22T21:28:36.068ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:46464
127702025-05-22T21:28:36.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46464 req_id = 19191516-9c06-4a22-8ccf-a860384fec66 roles = RoleSet { roles: {} } uri = /metrics/producers
127712025-05-22T21:28:36.069ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46464 req_id = 19191516-9c06-4a22-8ccf-a860384fec66 resource = Database result = Ok(()) uri = /metrics/producers
127722025-05-22T21:28:36.180ZINFOnexus: assigned collector to new producer collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 file = nexus/src/app/oximeter.rs:76 producer_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
127732025-05-22T21:28:36.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 112421 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:46464 req_id = 19191516-9c06-4a22-8ccf-a860384fec66 response_code = 201 uri = /metrics/producers
127742025-05-22T21:28:36.180ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "19191516-9c06-4a22-8ccf-a860384fec66", "content-length": "41", "date": "Thu, 22 May 2025 21:28:36 GMT"} })
127752025-05-22T21:28:36.183ZDEBGnexus (producer-registration-task): successfully registered with Nexus, pausing until time to renew lease lease_duration = 600s wait_period = 150s
127762025-05-22T21:28:36.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67206113-70ce-4b07-86c1-abcf0360fca8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127772025-05-22T21:28:36.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67206113-70ce-4b07-86c1-abcf0360fca8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127782025-05-22T21:28:36.442ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3557 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 67206113-70ce-4b07-86c1-abcf0360fca8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127792025-05-22T21:28:37.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e841929-dcb4-466e-94f2-3dedd5024ec3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127802025-05-22T21:28:37.462ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e841929-dcb4-466e-94f2-3dedd5024ec3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127812025-05-22T21:28:37.464ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8e841929-dcb4-466e-94f2-3dedd5024ec3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127822025-05-22T21:28:38.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 670 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 94802f8f-4cc0-44a5-bcb6-d74fab54e5ee response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
127832025-05-22T21:28:38.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cabf3a3b-f5e9-4b92-965c-d52624569ad9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127842025-05-22T21:28:38.479ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cabf3a3b-f5e9-4b92-965c-d52624569ad9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127852025-05-22T21:28:38.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2736 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cabf3a3b-f5e9-4b92-965c-d52624569ad9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127862025-05-22T21:28:39.496ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 427bf38b-c4dc-424e-9295-03a6fe633f23 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127872025-05-22T21:28:39.496ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 427bf38b-c4dc-424e-9295-03a6fe633f23 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127882025-05-22T21:28:39.498ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 427bf38b-c4dc-424e-9295-03a6fe633f23 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127892025-05-22T21:28:40.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5bafbcd7-e3d7-4674-a6c5-998c83546b97 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127902025-05-22T21:28:40.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5bafbcd7-e3d7-4674-a6c5-998c83546b97 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127912025-05-22T21:28:40.514ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2848 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5bafbcd7-e3d7-4674-a6c5-998c83546b97 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127922025-05-22T21:28:41.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c58bcd-f5db-4d79-b11c-2b5b52837df9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127932025-05-22T21:28:41.528ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c58bcd-f5db-4d79-b11c-2b5b52837df9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127942025-05-22T21:28:41.531ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2711 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b1c58bcd-f5db-4d79-b11c-2b5b52837df9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
127952025-05-22T21:28:41.563ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a18129a-6fd6-46bc-8407-b272281ef086", "content-length": "131", "date": "Thu, 22 May 2025 21:28:41 GMT"} })
127962025-05-22T21:28:41.568ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 8647f511-ad54-4702-85aa-858518f25beb sled_id = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-05-22T21:28:33.712893102Z }, migration_in: None, migration_out: None } vmm_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8
127972025-05-22T21:28:41.568ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2140 instance_id = 8647f511-ad54-4702-85aa-858518f25beb migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 sled_id = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 vmm_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2025-05-22T21:28:33.712893102Z }
127982025-05-22T21:28:41.568ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 8647f511-ad54-4702-85aa-858518f25beb roles = RoleSet { roles: {} } sled_id = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 vmm_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8
127992025-05-22T21:28:41.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 8647f511-ad54-4702-85aa-858518f25beb resource = Database result = Ok(()) sled_id = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 vmm_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8
128002025-05-22T21:28:41.621ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
128012025-05-22T21:28:41.623ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.537386823s iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
128022025-05-22T21:28:41.666ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a6006b6-aec1-4ed5-bde0-5a5db93eebc2 uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_state = VmmRuntimeState { state: Running, gen: Generation(3), time_updated: 2025-05-22T21:28:41.650355210Z }
128032025-05-22T21:28:41.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a6006b6-aec1-4ed5-bde0-5a5db93eebc2 roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128042025-05-22T21:28:41.667ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a6006b6-aec1-4ed5-bde0-5a5db93eebc2 resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128052025-05-22T21:28:41.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 56868 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7a6006b6-aec1-4ed5-bde0-5a5db93eebc2 response_code = 204 uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128062025-05-22T21:28:42.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6845769e-6730-435d-bd19-465b3d85b775 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128072025-05-22T21:28:42.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6845769e-6730-435d-bd19-465b3d85b775 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128082025-05-22T21:28:42.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6845769e-6730-435d-bd19-465b3d85b775 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128092025-05-22T21:28:43.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68d1ac7a-ca78-43da-bb76-37c9fa62f9ff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128102025-05-22T21:28:43.563ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68d1ac7a-ca78-43da-bb76-37c9fa62f9ff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128112025-05-22T21:28:43.565ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2518 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 68d1ac7a-ca78-43da-bb76-37c9fa62f9ff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128122025-05-22T21:28:44.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb3856ca-d15d-4299-b67e-f487720863e3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128132025-05-22T21:28:44.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb3856ca-d15d-4299-b67e-f487720863e3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128142025-05-22T21:28:44.581ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cb3856ca-d15d-4299-b67e-f487720863e3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128152025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
128162025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
128172025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128182025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128192025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128202025-05-22T21:28:45.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128212025-05-22T21:28:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128222025-05-22T21:28:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128232025-05-22T21:28:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128242025-05-22T21:28:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128252025-05-22T21:28:45.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128262025-05-22T21:28:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128272025-05-22T21:28:45.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128282025-05-22T21:28:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
128292025-05-22T21:28:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128302025-05-22T21:28:45.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128312025-05-22T21:28:45.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
128322025-05-22T21:28:45.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.417478ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
128332025-05-22T21:28:45.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128342025-05-22T21:28:45.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128352025-05-22T21:28:45.153ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 67.737048ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128362025-05-22T21:28:45.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c1d21fe-2b4a-4f52-a46c-8ba52e6859e6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128372025-05-22T21:28:45.596ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c1d21fe-2b4a-4f52-a46c-8ba52e6859e6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128382025-05-22T21:28:45.598ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6c1d21fe-2b4a-4f52-a46c-8ba52e6859e6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128392025-05-22T21:28:46.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38f0420e-0c8c-4820-835c-80f2554bc8be roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128402025-05-22T21:28:46.612ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38f0420e-0c8c-4820-835c-80f2554bc8be resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128412025-05-22T21:28:46.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 38f0420e-0c8c-4820-835c-80f2554bc8be response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128422025-05-22T21:28:47.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 88070da5-07ad-4d2b-87f5-ff84cc8eb9dc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128432025-05-22T21:28:47.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 88070da5-07ad-4d2b-87f5-ff84cc8eb9dc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128442025-05-22T21:28:47.631ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 88070da5-07ad-4d2b-87f5-ff84cc8eb9dc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128452025-05-22T21:28:48.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3002 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 5abd8697-78ae-4cda-a2fb-c296360674f6 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
128462025-05-22T21:28:48.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a629b6ae-3cf1-45ec-9ea0-62e85cb50fff roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128472025-05-22T21:28:48.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a629b6ae-3cf1-45ec-9ea0-62e85cb50fff resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128482025-05-22T21:28:48.647ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2664 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a629b6ae-3cf1-45ec-9ea0-62e85cb50fff response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128492025-05-22T21:28:49.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c75b2697-483c-4044-a028-061d36bdab26 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128502025-05-22T21:28:49.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c75b2697-483c-4044-a028-061d36bdab26 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128512025-05-22T21:28:49.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c75b2697-483c-4044-a028-061d36bdab26 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128522025-05-22T21:28:50.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc47a5a-8462-4048-98de-0f1e98b2592e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128532025-05-22T21:28:50.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc47a5a-8462-4048-98de-0f1e98b2592e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128542025-05-22T21:28:50.678ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6cc47a5a-8462-4048-98de-0f1e98b2592e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128552025-05-22T21:28:51.650ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 850a4cad-a576-4ac8-b129-f2002f7439d3 uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_state = VmmRuntimeState { state: Stopping, gen: Generation(5), time_updated: 2025-05-22T21:28:51.649804773Z }
128562025-05-22T21:28:51.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 850a4cad-a576-4ac8-b129-f2002f7439d3 roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128572025-05-22T21:28:51.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 850a4cad-a576-4ac8-b129-f2002f7439d3 resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128582025-05-22T21:28:51.691ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 41957 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 850a4cad-a576-4ac8-b129-f2002f7439d3 response_code = 204 uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128592025-05-22T21:28:51.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 195f90d4-b2b7-4baa-816d-0a2bff3dd709 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128602025-05-22T21:28:51.695ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 195f90d4-b2b7-4baa-816d-0a2bff3dd709 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128612025-05-22T21:28:51.696ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1842 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 195f90d4-b2b7-4baa-816d-0a2bff3dd709 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128622025-05-22T21:28:52.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d3de6ec-3925-4a51-b878-a440ad630525 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128632025-05-22T21:28:52.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d3de6ec-3925-4a51-b878-a440ad630525 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128642025-05-22T21:28:52.714ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3111 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 7d3de6ec-3925-4a51-b878-a440ad630525 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128652025-05-22T21:28:53.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d43b7c94-806e-48ed-bcf9-2f375a665ed1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128662025-05-22T21:28:53.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d43b7c94-806e-48ed-bcf9-2f375a665ed1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128672025-05-22T21:28:53.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d43b7c94-806e-48ed-bcf9-2f375a665ed1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
128682025-05-22T21:28:54.089ZINFOnexus (dropshot_internal): received new VMM runtime state from sled agent actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:2140 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2025-05-22T21:28:51.695098937Z }
128692025-05-22T21:28:54.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128702025-05-22T21:28:54.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128712025-05-22T21:28:54.098ZDEBGnexus (dropshot_internal): new VMM runtime state from sled agent requires an instance-update saga actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_in_needs_update = false migration_out_needs_update = false propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_needs_update = true
128722025-05-22T21:28:54.098ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128732025-05-22T21:28:54.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128742025-05-22T21:28:54.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128752025-05-22T21:28:54.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128762025-05-22T21:28:54.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128772025-05-22T21:28:54.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128782025-05-22T21:28:54.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128792025-05-22T21:28:54.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128802025-05-22T21:28:54.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128812025-05-22T21:28:54.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128822025-05-22T21:28:54.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128832025-05-22T21:28:54.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Database result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128842025-05-22T21:28:54.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128852025-05-22T21:28:54.115ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: 8647f511-ad54-4702-85aa-858518f25beb, lookup_type: ById(8647f511-ad54-4702-85aa-858518f25beb) } result = Ok(()) uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128862025-05-22T21:28:54.126ZINFOnexus (dropshot_internal): starting update saga for 8647f511-ad54-4702-85aa-858518f25beb actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/instance.rs:1603 instance_id = 8647f511-ad54-4702-85aa-858518f25beb local_addr = [fd00:1122:3344:101::b]:12221 method = PUT migration_state = Migrations { migration_in: None, migration_out: None } remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8 vmm_state = VmmRuntimeState { state: Destroyed, gen: Generation(6), time_updated: 2025-05-22T21:28:51.695098937Z }
128872025-05-22T21:28:54.126ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 37915 local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc response_code = 204 uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128882025-05-22T21:28:54.129ZDEBGnexus (dropshot_internal): preparing instance-update saga for 8647f511-ad54-4702-85aa-858518f25beb... actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8647f511-ad54-4702-85aa-858518f25beb local_addr = [fd00:1122:3344:101::b]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aa1d2d60-9994-4cf9-b48f-c07f7b037ecc uri = /vmms/b3790d40-8c31-424e-ac39-d3f0a5064aa8
128892025-05-22T21:28:54.129ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update
128902025-05-22T21:28:54.129ZINFOnexus (SEC): saga create dag = {"end_node":4,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,0,null],[2,4,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"start_instance_update.lock_instance","label":"LockInstance","name":"updater_lock"}},{"Action":{"action_name":"start_instance_update.fetch_state_and_start_real_saga","label":"FetchStateAndStartRealSaga","name":"state"}},{"Start":{"params":{"authz_instance":{"key":"8647f511-ad54-4702-85aa-858518f25beb","lookup_type":{"ById":"8647f511-ad54-4702-85aa-858518f25beb"},"parent":{"key":"98ba8f01-fe18-4615-b5d5-b795e9418a7c","lookup_type":{"ById":"98ba8f01-fe18-4615-b5d5-b795e9418a7c"},"parent":{"key":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","lookup_type":{"ById":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4"},"parent":null}}},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}}}}},"End"]},"saga_name":"start-instance-update","start_node":3} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
128912025-05-22T21:28:54.129ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update
128922025-05-22T21:28:54.168ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update
128932025-05-22T21:28:54.168ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
128942025-05-22T21:28:54.170ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
128952025-05-22T21:28:54.170ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
128962025-05-22T21:28:54.176ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
128972025-05-22T21:28:54.176ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
128982025-05-22T21:28:54.183ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
128992025-05-22T21:28:54.183ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
129002025-05-22T21:28:54.188ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129012025-05-22T21:28:54.188ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("d858aaaf-ba8c-47ec-95cb-60959ebe4197")) node_id = 0 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
129022025-05-22T21:28:54.192ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129032025-05-22T21:28:54.192ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
129042025-05-22T21:28:54.213ZINFOnexus (SagaExecutor): instance update: attempting to lock instance file = nexus/src/app/sagas/instance_update/start.rs:93 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update
129052025-05-22T21:28:54.215ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129062025-05-22T21:28:54.216ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129072025-05-22T21:28:54.217ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129082025-05-22T21:28:54.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129092025-05-22T21:28:54.219ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129102025-05-22T21:28:54.219ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129112025-05-22T21:28:54.225ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129122025-05-22T21:28:54.225ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129132025-05-22T21:28:54.226ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129142025-05-22T21:28:54.226ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129152025-05-22T21:28:54.227ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129162025-05-22T21:28:54.227ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129172025-05-22T21:28:54.229ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129182025-05-22T21:28:54.232ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: 8647f511-ad54-4702-85aa-858518f25beb, lookup_type: ById(8647f511-ad54-4702-85aa-858518f25beb) } result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129192025-05-22T21:28:54.232ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance updater_id = d858aaaf-ba8c-47ec-95cb-60959ebe4197
129202025-05-22T21:28:54.232ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129212025-05-22T21:28:54.232ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129222025-05-22T21:28:54.244ZDEBGnexus (SagaExecutor): attempting to acquire instance updater lock actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true current_gen = Generation(Generation(1)) instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance updater_id = d858aaaf-ba8c-47ec-95cb-60959ebe4197
129232025-05-22T21:28:54.244ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129242025-05-22T21:28:54.244ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance
129252025-05-22T21:28:54.248ZDEBGnexus (SagaExecutor): instance updater lock acquired! actor_id = 001de000-05e4-4000-8000-000000000002 already_locked = true authenticated = true instance_id = 8647f511-ad54-4702-85aa-858518f25beb locked_gen = Generation(Generation(2)) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = LockInstance updater_id = d858aaaf-ba8c-47ec-95cb-60959ebe4197
129262025-05-22T21:28:54.253ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129272025-05-22T21:28:54.253ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d858aaaf-ba8c-47ec-95cb-60959ebe4197")}) node_id = 1 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
129282025-05-22T21:28:54.256ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129292025-05-22T21:28:54.256ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
129302025-05-22T21:28:54.264ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129312025-05-22T21:28:54.264ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129322025-05-22T21:28:54.266ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129332025-05-22T21:28:54.266ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129342025-05-22T21:28:54.267ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129352025-05-22T21:28:54.267ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129362025-05-22T21:28:54.268ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129372025-05-22T21:28:54.272ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: 8647f511-ad54-4702-85aa-858518f25beb, lookup_type: ById(8647f511-ad54-4702-85aa-858518f25beb) } result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129382025-05-22T21:28:54.272ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129392025-05-22T21:28:54.272ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_node = FetchStateAndStartRealSaga
129402025-05-22T21:28:54.280ZINFOnexus (SagaExecutor): instance update: starting real update saga... current.active_vmm = Some(Vmm { id: b3790d40-8c31-424e-ac39-d3f0a5064aa8, time_created: 2025-05-22T21:28:33.193696Z, time_deleted: None, instance_id: 8647f511-ad54-4702-85aa-858518f25beb, sled_id: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, propolis_ip: V6(Ipv6Network { addr: fd00:1122:3344:101::1:0, prefix: 128 }), propolis_port: SqlU16(12400), runtime: VmmRuntimeState { time_state_updated: 2025-05-22T21:28:51.695098Z, gen: Generation(Generation(6)), state: Destroyed } }) current.migration = None current.runtime_state = InstanceRuntimeState { time_updated: 2025-05-22T21:28:30.979786Z, gen: Generation(Generation(3)), propolis_id: Some(b3790d40-8c31-424e-ac39-d3f0a5064aa8), dst_propolis_id: None, migration_id: None, nexus_state: Vmm, time_last_auto_restarted: None } current.target_vmm = None file = nexus/src/app/sagas/instance_update/start.rs:180 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update update.deprovision = true update.destroy_active_vmm = Some(b3790d40-8c31-424e-ac39-d3f0a5064aa8 (propolis)) update.destroy_target_vmm = None update.network_config_update = Some(Delete) update.new_runtime_state = InstanceRuntimeState { time_updated: 2025-05-22T21:28:54.280244787Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None }
129412025-05-22T21:28:54.282ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129422025-05-22T21:28:54.282ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,10,null],[8,9,null],[10,11,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateInstanceLockId","name":"saga_instance_lock_id"}},{"Action":{"action_name":"instance_update.become_updater","label":"BecomeUpdater","name":"updater_lock"}},{"Constant":{"name":"network_config_update","value":"Delete"}},{"Action":{"action_name":"instance_update.update_network_config","label":"UpdateNetworkConfig","name":"update_network_config"}},{"Action":{"action_name":"instance_update.release_virtual_provisioning","label":"ReleaseVirtualProvisioning","name":"release_virtual_provisioning"}},{"Action":{"action_name":"instance_update.unassign_oximeter_producer","label":"UnassignOximeterProducer","name":"unassign_oximeter_producer"}},{"Action":{"action_name":"instance_update.commit_instance_updates","label":"CommitInstanceUpdates","name":"commit_instance_updates"}},{"Constant":{"name":"destroy_active_vmm_params","value":{"instance_id":"8647f511-ad54-4702-85aa-858518f25beb","serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"vmm_id":"b3790d40-8c31-424e-ac39-d3f0a5064aa8"}}},{"SubsagaStart":{"params_node_name":"destroy_active_vmm_params","saga_name":"destroy_active_vmm"}},{"Action":{"action_name":"destroy_vmm.release_sled_resources","label":"ReleaseSledResources","name":"release_sled_resources"}},{"Action":{"action_name":"destroy_vmm.mark_vmm_deleted","label":"MarkVmmDeleted","name":"mark_vmm_deleted"}},{"SubsagaEnd":{"name":"active_vmm_destroyed"}},{"Action":{"action_name":"instance_update.chain_successor_saga","label":"ChainSuccessorSaga","name":"chain_successor_saga"}},{"Start":{"params":{"authz_instance":{"key":"8647f511-ad54-4702-85aa-858518f25beb","lookup_type":{"ById":"8647f511-ad54-4702-85aa-858518f25beb"},"parent":{"key":"98ba8f01-fe18-4615-b5d5-b795e9418a7c","lookup_type":{"ById":"98ba8f01-fe18-4615-b5d5-b795e9418a7c"},"parent":{"key":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","lookup_type":{"ById":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4"},"parent":null}}},"orig_lock":{"locked_gen":2,"updater_id":"d858aaaf-ba8c-47ec-95cb-60959ebe4197"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"UserBuiltin":{"user_builtin_id":"001de000-05e4-4000-8000-000000000002"}}},null]}},"update":{"deprovision":{"cpus_diff":2,"project_id":"98ba8f01-fe18-4615-b5d5-b795e9418a7c","ram_diff":1073741824},"destroy_active_vmm":"b3790d40-8c31-424e-ac39-d3f0a5064aa8","destroy_target_vmm":null,"network_config":"Delete","new_intent":null,"new_runtime":{"dst_propolis_id":null,"gen":4,"migration_id":null,"nexus_state":"NoVmm","propolis_id":null,"time_last_auto_restarted":null,"time_updated":"2025-05-22T21:28:54.280244787Z"}}}}},"End"]},"saga_name":"instance-update","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1146 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129432025-05-22T21:28:54.282ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129442025-05-22T21:28:54.286ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129452025-05-22T21:28:54.286ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:967 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129462025-05-22T21:28:54.286ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129472025-05-22T21:28:54.286ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129482025-05-22T21:28:54.289ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129492025-05-22T21:28:54.289ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129502025-05-22T21:28:54.292ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129512025-05-22T21:28:54.292ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129522025-05-22T21:28:54.295ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129532025-05-22T21:28:54.295ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("087f256a-a167-4616-835b-663321c7eca5")) node_id = 0 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129542025-05-22T21:28:54.298ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129552025-05-22T21:28:54.298ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129562025-05-22T21:28:54.301ZDEBGnexus (SagaExecutor): instance update: trying to become instance updater... instance_id = 8647f511-ad54-4702-85aa-858518f25beb parent_lock = UpdaterLock { updater_id: d858aaaf-ba8c-47ec-95cb-60959ebe4197, locked_gen: Generation(Generation(2)) } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129572025-05-22T21:28:54.301ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = BecomeUpdater
129582025-05-22T21:28:54.301ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = BecomeUpdater
129592025-05-22T21:28:54.311ZDEBGnexus (SagaExecutor): inherited lock from d858aaaf-ba8c-47ec-95cb-60959ebe4197 to 087f256a-a167-4616-835b-663321c7eca5 actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true instance_id = 8647f511-ad54-4702-85aa-858518f25beb locked_gen = Generation(Generation(3)) parent_gen = Generation(Generation(2)) parent_id = d858aaaf-ba8c-47ec-95cb-60959ebe4197 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = BecomeUpdater updater_id = 087f256a-a167-4616-835b-663321c7eca5
129602025-05-22T21:28:54.311ZINFOnexus (SagaExecutor): instance_update: Now, I am become Updater, the destroyer of VMMs. file = nexus/src/app/sagas/instance_update/mod.rs:987 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129612025-05-22T21:28:54.311ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129622025-05-22T21:28:54.311ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"locked_gen": Number(3), "updater_id": String("087f256a-a167-4616-835b-663321c7eca5")}) node_id = 1 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129632025-05-22T21:28:54.314ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129642025-05-22T21:28:54.314ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129652025-05-22T21:28:54.317ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129662025-05-22T21:28:54.317ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("Delete")) node_id = 2 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129672025-05-22T21:28:54.320ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129682025-05-22T21:28:54.320ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129692025-05-22T21:28:54.326ZINFOnexus (SagaExecutor): instance update: deleting network config file = nexus/src/app/sagas/instance_update/mod.rs:1040 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
129702025-05-22T21:28:54.326ZINFOnexus: deleting instance dpd configuration file = nexus/src/app/instance_network.rs:548 instance_id = 8647f511-ad54-4702-85aa-858518f25beb
129712025-05-22T21:28:54.326ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129722025-05-22T21:28:54.326ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129732025-05-22T21:28:54.333ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129742025-05-22T21:28:54.333ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129752025-05-22T21:28:54.341ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
129762025-05-22T21:28:54.341ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129772025-05-22T21:28:54.341ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UpdateNetworkConfig
129782025-05-22T21:28:54.343ZWARNnexus: no matching nat entries to soft delete file = nexus/src/app/instance_network.rs:711
129792025-05-22T21:28:54.343ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
129802025-05-22T21:28:54.343ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
129812025-05-22T21:28:54.345ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
129822025-05-22T21:28:54.346ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Fleet result = Ok(())
129832025-05-22T21:28:54.346ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
129842025-05-22T21:28:54.346ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
129852025-05-22T21:28:54.351ZDEBGnexus: notifying dendrite of updates instance_id = Some(8647f511-ad54-4702-85aa-858518f25beb (instance)) switch = switch0
129862025-05-22T21:28:54.351ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1643, tv_nsec: 494267894 } })
129872025-05-22T21:28:54.352ZINFOnexus: Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1178
129882025-05-22T21:28:54.381ZINFOnexus: determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
129892025-05-22T21:28:54.381ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129902025-05-22T21:28:54.382ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d5a1af8-e63f-4156-bc72-dee18b36e0f7", "content-length": "26", "date": "Thu, 22 May 2025 21:28:54 GMT"} })
129912025-05-22T21:28:54.382ZINFOnexus: identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129922025-05-22T21:28:54.382ZINFOnexus: completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129932025-05-22T21:28:54.416ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129942025-05-22T21:28:54.416ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129952025-05-22T21:28:54.419ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
129962025-05-22T21:28:54.419ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
129972025-05-22T21:28:54.427ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
129982025-05-22T21:28:54.427ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ReleaseVirtualProvisioning
129992025-05-22T21:28:54.441ZINFOnexus (SagaExecutor): instance update (no VMM): deallocated virtual provisioning resources file = nexus/src/app/sagas/instance_update/mod.rs:1115 instance_id = 8647f511-ad54-4702-85aa-858518f25beb records_deleted = [VirtualProvisioningCollection { id: 001de000-1334-4000-8000-000000000000, time_modified: Some(2025-05-22T21:28:54.431022Z), collection_type: "Fleet", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, time_modified: Some(2025-05-22T21:28:54.431022Z), collection_type: "Project", virtual_disk_bytes_provisioned: ByteCount(ByteCount(2147483648)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }, VirtualProvisioningCollection { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, time_modified: Some(2025-05-22T21:28:54.431022Z), collection_type: "Silo", virtual_disk_bytes_provisioned: ByteCount(ByteCount(6442450944)), cpus_provisioned: 0, ram_provisioned: ByteCount(ByteCount(0)) }] saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130002025-05-22T21:28:54.441ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130012025-05-22T21:28:54.441ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130022025-05-22T21:28:54.444ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130032025-05-22T21:28:54.444ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130042025-05-22T21:28:54.448ZINFOnexus (SagaExecutor): instance update (no VMM): unassigning oximeter producer file = nexus/src/app/sagas/instance_update/mod.rs:1150 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130052025-05-22T21:28:54.448ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UnassignOximeterProducer
130062025-05-22T21:28:54.448ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UnassignOximeterProducer
130072025-05-22T21:28:54.457ZDEBGnexus (SagaExecutor): deleted metric producer assignment collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 producer_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130082025-05-22T21:28:54.457ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UnassignOximeterProducer
130092025-05-22T21:28:54.457ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = UnassignOximeterProducer
130102025-05-22T21:28:54.496ZINFOnexus (SagaExecutor): registered oximeter collector client file = nexus/src/app/oximeter.rs:262 id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130112025-05-22T21:28:54.496ZDEBGnexus (SagaExecutor): client request body = None method = DELETE oximeter-collector = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update uri = http://[fd00:1122:3344:101::d]:12223/producers/8647f511-ad54-4702-85aa-858518f25beb
130122025-05-22T21:28:54.520ZDEBGnexus (SagaExecutor): client response oximeter-collector = 8647f511-ad54-4702-85aa-858518f25beb result = Ok(Response { url: "http://[fd00:1122:3344:101::d]:12223/producers/8647f511-ad54-4702-85aa-858518f25beb", status: 204, headers: {"x-request-id": "a3fa8284-67d0-462f-90bd-4b5d205d35c9", "date": "Thu, 22 May 2025 21:28:54 GMT"} }) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130132025-05-22T21:28:54.520ZDEBGnexus (SagaExecutor): successfully deleted producer from collector address = [fd00:1122:3344:101::d]:12223 collector_id = 5d686ed8-2833-474e-a52b-856ddeb711e7 producer_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130142025-05-22T21:28:54.521ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130152025-05-22T21:28:54.521ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130162025-05-22T21:28:54.525ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130172025-05-22T21:28:54.525ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130182025-05-22T21:28:54.531ZDEBGnexus (SagaExecutor): instance update: committing new runtime state and unlocking... instance_id = 8647f511-ad54-4702-85aa-858518f25beb lock = UpdaterLock { updater_id: 087f256a-a167-4616-835b-663321c7eca5, locked_gen: Generation(Generation(3)) } new_intent = None new_runtime = InstanceRuntimeState { time_updated: 2025-05-22T21:28:54.280244787Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130192025-05-22T21:28:54.531ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = CommitInstanceUpdates
130202025-05-22T21:28:54.531ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = CommitInstanceUpdates
130212025-05-22T21:28:54.576ZINFOnexus (SagaExecutor): instance update: committed update new runtime state! did_unlock = true file = nexus/src/app/sagas/instance_update/mod.rs:1201 instance_id = 8647f511-ad54-4702-85aa-858518f25beb new_runtime = InstanceRuntimeState { time_updated: 2025-05-22T21:28:54.280244787Z, gen: Generation(Generation(4)), propolis_id: None, dst_propolis_id: None, migration_id: None, nexus_state: NoVmm, time_last_auto_restarted: None } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130222025-05-22T21:28:54.576ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130232025-05-22T21:28:54.576ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130242025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Signaled
130252025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Signaled
130262025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130272025-05-22T21:28:54.576ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
130282025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130292025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130302025-05-22T21:28:54.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130312025-05-22T21:28:54.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130322025-05-22T21:28:54.579ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130332025-05-22T21:28:54.579ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130342025-05-22T21:28:54.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130352025-05-22T21:28:54.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130362025-05-22T21:28:54.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130372025-05-22T21:28:54.582ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130382025-05-22T21:28:54.582ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130392025-05-22T21:28:54.582ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"instance_id": String("8647f511-ad54-4702-85aa-858518f25beb"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3790d40-8c31-424e-ac39-d3f0a5064aa8")}) node_id = 7 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130402025-05-22T21:28:54.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
130412025-05-22T21:28:54.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130422025-05-22T21:28:54.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130432025-05-22T21:28:54.585ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130442025-05-22T21:28:54.585ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130452025-05-22T21:28:54.589ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130462025-05-22T21:28:54.589ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130472025-05-22T21:28:54.594ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130482025-05-22T21:28:54.594ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130492025-05-22T21:28:54.598ZINFOnexus (SagaExecutor): instance update (VMM destroyed): deallocating sled resource reservation file = nexus/src/app/sagas/instance_update/destroyed.rs:82 instance_id = 8647f511-ad54-4702-85aa-858518f25beb propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130502025-05-22T21:28:54.598ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ReleaseSledResources
130512025-05-22T21:28:54.599ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ReleaseSledResources
130522025-05-22T21:28:54.612ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130532025-05-22T21:28:54.612ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130542025-05-22T21:28:54.615ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130552025-05-22T21:28:54.615ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130562025-05-22T21:28:54.620ZINFOnexus (SagaExecutor): instance update (VMM destroyed): marking VMM record deleted file = nexus/src/app/sagas/instance_update/destroyed.rs:113 instance_id = 8647f511-ad54-4702-85aa-858518f25beb propolis_id = b3790d40-8c31-424e-ac39-d3f0a5064aa8 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130572025-05-22T21:28:54.620ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = MarkVmmDeleted
130582025-05-22T21:28:54.620ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = MarkVmmDeleted
130592025-05-22T21:28:54.629ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130602025-05-22T21:28:54.629ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130612025-05-22T21:28:54.632ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130622025-05-22T21:28:54.632ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130632025-05-22T21:28:54.635ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130642025-05-22T21:28:54.635ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130652025-05-22T21:28:54.639ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130662025-05-22T21:28:54.639ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130672025-05-22T21:28:54.642ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130682025-05-22T21:28:54.642ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130692025-05-22T21:28:54.680ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130702025-05-22T21:28:54.680ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130712025-05-22T21:28:54.681ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130722025-05-22T21:28:54.681ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130732025-05-22T21:28:54.681ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "871a1371-aa2d-4361-8f51-c0106cb24a65", "content-length": "372", "date": "Thu, 22 May 2025 21:28:54 GMT"} })
130742025-05-22T21:28:54.681ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130752025-05-22T21:28:54.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130762025-05-22T21:28:54.681ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130772025-05-22T21:28:54.682ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130782025-05-22T21:28:54.686ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
130792025-05-22T21:28:54.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
130802025-05-22T21:28:54.721ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130812025-05-22T21:28:54.725ZDEBGnexus (SagaExecutor): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Instance { parent: Project { parent: Silo { parent: Fleet, key: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, lookup_type: ById(de8df5b2-66ea-4dc0-9fef-ace14414c8a4) }, key: 98ba8f01-fe18-4615-b5d5-b795e9418a7c, lookup_type: ById(98ba8f01-fe18-4615-b5d5-b795e9418a7c) }, key: 8647f511-ad54-4702-85aa-858518f25beb, lookup_type: ById(8647f511-ad54-4702-85aa-858518f25beb) } result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130822025-05-22T21:28:54.725ZDEBGnexus (SagaExecutor): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true roles = RoleSet { roles: {} } saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130832025-05-22T21:28:54.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true resource = Database result = Ok(()) saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_node = ChainSuccessorSaga
130842025-05-22T21:28:54.730ZDEBGnexus (SagaExecutor): instance update: instance will not reincarnate auto_restart_config = InstanceAutoRestart { policy: None, cooldown: None } instance_id = 8647f511-ad54-4702-85aa-858518f25beb intended_state = destroyed karmic_state = WillReincarnate needs_reincarnation = false saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update
130852025-05-22T21:28:54.730ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
130862025-05-22T21:28:54.730ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130872025-05-22T21:28:54.730ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130882025-05-22T21:28:54.730ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
130892025-05-22T21:28:54.730ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "eab667d9-2971-42a9-809b-7d78f3247128", "date": "Thu, 22 May 2025 21:28:54 GMT"} })
130902025-05-22T21:28:54.730ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130912025-05-22T21:28:54.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130922025-05-22T21:28:54.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130932025-05-22T21:28:54.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130942025-05-22T21:28:54.735ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130952025-05-22T21:28:54.735ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
130962025-05-22T21:28:54.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130972025-05-22T21:28:54.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130982025-05-22T21:28:54.739ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
130992025-05-22T21:28:54.739ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
131002025-05-22T21:28:54.739ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
131012025-05-22T21:28:54.739ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131022025-05-22T21:28:54.740ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "7009b203-8097-43ec-a0a6-dd287c4c622d", "date": "Thu, 22 May 2025 21:28:54 GMT"} })
131032025-05-22T21:28:54.741ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 165.333881ms iteration = 24 status = {}
131042025-05-22T21:28:54.742ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131052025-05-22T21:28:54.742ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0
131062025-05-22T21:28:54.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a3ebc0ba-dbac-43b3-a4e5-8648adf2f652 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131072025-05-22T21:28:54.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a3ebc0ba-dbac-43b3-a4e5-8648adf2f652 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131082025-05-22T21:28:54.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a3ebc0ba-dbac-43b3-a4e5-8648adf2f652 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131092025-05-22T21:28:54.783ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131102025-05-22T21:28:54.783ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 saga_name = instance-update saga_result = SagaResult { saga_id: dae441d2-21b5-43e4-bd23-1ad580945bd0, saga_log: SagaLog { saga_id: dae441d2-21b5-43e4-bd23-1ad580945bd0, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(String("087f256a-a167-4616-835b-663321c7eca5")), 1: Succeeded(Object {"locked_gen": Number(3), "updater_id": String("087f256a-a167-4616-835b-663321c7eca5")}), 2: Succeeded(String("Delete")), 3: Succeeded(Null), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Object {"instance_id": String("8647f511-ad54-4702-85aa-858518f25beb"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3790d40-8c31-424e-ac39-d3f0a5064aa8")}), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"active_vmm_destroyed": Null, "chain_successor_saga": Null, "commit_instance_updates": Null, "destroy_active_vmm_params": Object {"instance_id": String("8647f511-ad54-4702-85aa-858518f25beb"), "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"UserBuiltin": Object {"user_builtin_id": String("001de000-05e4-4000-8000-000000000002")}}}, Null]}}, "vmm_id": String("b3790d40-8c31-424e-ac39-d3f0a5064aa8")}, "mark_vmm_deleted": Null, "network_config_update": String("Delete"), "release_sled_resources": Null, "release_virtual_provisioning": Null, "saga_instance_lock_id": String("087f256a-a167-4616-835b-663321c7eca5"), "unassign_oximeter_producer": Null, "update_network_config": Null, "updater_lock": Object {"locked_gen": Number(3), "updater_id": String("087f256a-a167-4616-835b-663321c7eca5")}} }) }
131112025-05-22T21:28:54.784ZDEBGnexus (SagaExecutor): instance update: child saga completed successfully child_saga_id = dae441d2-21b5-43e4-bd23-1ad580945bd0 instance_id = 8647f511-ad54-4702-85aa-858518f25beb saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update
131122025-05-22T21:28:54.784ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131132025-05-22T21:28:54.784ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
131142025-05-22T21:28:54.787ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131152025-05-22T21:28:54.787ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
131162025-05-22T21:28:54.790ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131172025-05-22T21:28:54.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
131182025-05-22T21:28:54.793ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131192025-05-22T21:28:54.793ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189
131202025-05-22T21:28:54.794ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131212025-05-22T21:28:54.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131222025-05-22T21:28:54.796ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131232025-05-22T21:28:54.798ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131242025-05-22T21:28:54.798ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131252025-05-22T21:28:54.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131262025-05-22T21:28:54.830ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131272025-05-22T21:28:54.830ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update sec_id = 548ef0f1-b45a-42d9-a620-b374dd0fb713
131282025-05-22T21:28:54.830ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = de2282ce-71f0-4646-8fc5-ba3623dcf189 saga_name = start-instance-update saga_result = SagaResult { saga_id: de2282ce-71f0-4646-8fc5-ba3623dcf189, saga_log: SagaLog { saga_id: de2282ce-71f0-4646-8fc5-ba3623dcf189, unwinding: false, events: [N003 started, N003 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N004 started, N004 succeeded], node_status: {0: Succeeded(String("d858aaaf-ba8c-47ec-95cb-60959ebe4197")), 1: Succeeded(Object {"locked_gen": Number(2), "updater_id": String("d858aaaf-ba8c-47ec-95cb-60959ebe4197")}), 2: Succeeded(Null), 3: Succeeded(Null), 4: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"saga_instance_lock_id": String("d858aaaf-ba8c-47ec-95cb-60959ebe4197"), "state": Null, "updater_lock": Object {"locked_gen": Number(2), "updater_id": String("d858aaaf-ba8c-47ec-95cb-60959ebe4197")}} }) }
131292025-05-22T21:28:54.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
131302025-05-22T21:28:54.832ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
131312025-05-22T21:28:54.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
131322025-05-22T21:28:54.922ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
131332025-05-22T21:28:54.923ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac1a5212-3971-4cb4-a5ff-36689586bf00", "content-length": "691", "date": "Thu, 22 May 2025 21:28:54 GMT"} })
131342025-05-22T21:28:54.923ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
131352025-05-22T21:28:54.923ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
131362025-05-22T21:28:54.923ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
131372025-05-22T21:28:54.924ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 347.701735ms iteration = 24 status = {}
131382025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
131392025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
131402025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131412025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131422025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131432025-05-22T21:28:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131442025-05-22T21:28:55.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131452025-05-22T21:28:55.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131462025-05-22T21:28:55.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.015669ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131472025-05-22T21:28:55.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131482025-05-22T21:28:55.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131492025-05-22T21:28:55.131ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131502025-05-22T21:28:55.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131512025-05-22T21:28:55.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131522025-05-22T21:28:55.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131532025-05-22T21:28:55.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131542025-05-22T21:28:55.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
131552025-05-22T21:28:55.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131562025-05-22T21:28:55.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131572025-05-22T21:28:55.148ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
131582025-05-22T21:28:55.148ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 62.002903ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
131592025-05-22T21:28:55.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94d725b0-7e12-4043-8c20-459bd9e65787 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131602025-05-22T21:28:55.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94d725b0-7e12-4043-8c20-459bd9e65787 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131612025-05-22T21:28:55.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94d725b0-7e12-4043-8c20-459bd9e65787 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131622025-05-22T21:28:56.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2512844e-f1e6-41df-be3d-d40c99569b08 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131632025-05-22T21:28:56.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2512844e-f1e6-41df-be3d-d40c99569b08 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131642025-05-22T21:28:56.779ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2213 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2512844e-f1e6-41df-be3d-d40c99569b08 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131652025-05-22T21:28:57.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a55ff02c-ec10-4d93-8397-59bf177ebc71 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131662025-05-22T21:28:57.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a55ff02c-ec10-4d93-8397-59bf177ebc71 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131672025-05-22T21:28:57.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a55ff02c-ec10-4d93-8397-59bf177ebc71 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131682025-05-22T21:28:58.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 767 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 75f00643-c33c-4f64-8252-ce8b6cd2f318 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
131692025-05-22T21:28:58.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53210c64-8924-4f89-9d40-b66c2297d95a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131702025-05-22T21:28:58.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53210c64-8924-4f89-9d40-b66c2297d95a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131712025-05-22T21:28:58.813ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 53210c64-8924-4f89-9d40-b66c2297d95a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131722025-05-22T21:28:59.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1678f77-cb68-4c7a-a7e8-bbb3e980f45d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131732025-05-22T21:28:59.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1678f77-cb68-4c7a-a7e8-bbb3e980f45d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131742025-05-22T21:28:59.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2103 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c1678f77-cb68-4c7a-a7e8-bbb3e980f45d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131752025-05-22T21:29:00.844ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69b5ac39-87c8-4b6e-b331-411ce92f2bf1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131762025-05-22T21:29:00.844ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69b5ac39-87c8-4b6e-b331-411ce92f2bf1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131772025-05-22T21:29:00.846ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1873 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 69b5ac39-87c8-4b6e-b331-411ce92f2bf1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131782025-05-22T21:29:01.859ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1e237a93-7f4a-4a1c-bff0-46f3e90a5a58 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131792025-05-22T21:29:01.860ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1e237a93-7f4a-4a1c-bff0-46f3e90a5a58 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131802025-05-22T21:29:01.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1e237a93-7f4a-4a1c-bff0-46f3e90a5a58 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131812025-05-22T21:29:02.876ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1295fdf6-4732-484f-8c17-823ea100d79e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131822025-05-22T21:29:02.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1295fdf6-4732-484f-8c17-823ea100d79e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131832025-05-22T21:29:02.878ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2473 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1295fdf6-4732-484f-8c17-823ea100d79e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131842025-05-22T21:29:03.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 11e11d68-080a-40a7-8305-8df9ed155a23 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131852025-05-22T21:29:03.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 11e11d68-080a-40a7-8305-8df9ed155a23 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131862025-05-22T21:29:03.893ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 11e11d68-080a-40a7-8305-8df9ed155a23 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131872025-05-22T21:29:04.907ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13e66615-c205-4dc3-881d-dffc358e65cc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131882025-05-22T21:29:04.907ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13e66615-c205-4dc3-881d-dffc358e65cc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131892025-05-22T21:29:04.909ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 13e66615-c205-4dc3-881d-dffc358e65cc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
131902025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
131912025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
131922025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
131932025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131942025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 24 reason = Timeout
131952025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
131962025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
131972025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
131982025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
131992025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132002025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132012025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
132022025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
132032025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
132042025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
132052025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
132062025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132072025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 24 reason = Timeout
132082025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132092025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
132102025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132112025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
132122025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
132132025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132142025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
132152025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
132162025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
132172025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
132182025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132192025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
132202025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
132212025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132222025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
132232025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132242025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
132252025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
132262025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
132272025-05-22T21:29:05.086ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132282025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132292025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132302025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
132312025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
132322025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132332025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132342025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132352025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
132362025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132372025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132382025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132392025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132402025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
132412025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132422025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
132432025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132442025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132452025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132462025-05-22T21:29:05.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132472025-05-22T21:29:05.093ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
132482025-05-22T21:29:05.093ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
132492025-05-22T21:29:05.093ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132502025-05-22T21:29:05.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132512025-05-22T21:29:05.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132522025-05-22T21:29:05.094ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 8.394316ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132532025-05-22T21:29:05.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132542025-05-22T21:29:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
132552025-05-22T21:29:05.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132562025-05-22T21:29:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132572025-05-22T21:29:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132582025-05-22T21:29:05.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132592025-05-22T21:29:05.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132602025-05-22T21:29:05.107ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132612025-05-22T21:29:05.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132622025-05-22T21:29:05.110ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1654, tv_nsec: 252725774 } })
132632025-05-22T21:29:05.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
132642025-05-22T21:29:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
132652025-05-22T21:29:05.112ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
132662025-05-22T21:29:05.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
132672025-05-22T21:29:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132682025-05-22T21:29:05.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132692025-05-22T21:29:05.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132702025-05-22T21:29:05.118ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1654, tv_nsec: 260511380 } })
132712025-05-22T21:29:05.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
132722025-05-22T21:29:05.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132732025-05-22T21:29:05.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132742025-05-22T21:29:05.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132752025-05-22T21:29:05.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132762025-05-22T21:29:05.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132772025-05-22T21:29:05.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132782025-05-22T21:29:05.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132792025-05-22T21:29:05.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
132802025-05-22T21:29:05.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132812025-05-22T21:29:05.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132822025-05-22T21:29:05.152ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132832025-05-22T21:29:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132842025-05-22T21:29:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.514415ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
132852025-05-22T21:29:05.155ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 69.790358ms iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
132862025-05-22T21:29:05.157ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.710857ms iteration = 24 status = {"errors":[],"requests_created_ok":[]}
132872025-05-22T21:29:05.158ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132882025-05-22T21:29:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
132892025-05-22T21:29:05.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132902025-05-22T21:29:05.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132912025-05-22T21:29:05.162ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132922025-05-22T21:29:05.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132932025-05-22T21:29:05.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.964665ms iteration = 24 status = {"errors":[],"finish_invoked_ok":[]}
132942025-05-22T21:29:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
132952025-05-22T21:29:05.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132962025-05-22T21:29:05.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132972025-05-22T21:29:05.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132982025-05-22T21:29:05.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132992025-05-22T21:29:05.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133002025-05-22T21:29:05.167ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133012025-05-22T21:29:05.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133022025-05-22T21:29:05.169ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133032025-05-22T21:29:05.169ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
133042025-05-22T21:29:05.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
133052025-05-22T21:29:05.169ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1654, tv_nsec: 312361092 } })
133062025-05-22T21:29:05.170ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
133072025-05-22T21:29:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
133082025-05-22T21:29:05.173ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
133092025-05-22T21:29:05.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
133102025-05-22T21:29:05.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133112025-05-22T21:29:05.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133122025-05-22T21:29:05.177ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133132025-05-22T21:29:05.177ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
133142025-05-22T21:29:05.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133152025-05-22T21:29:05.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133162025-05-22T21:29:05.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133172025-05-22T21:29:05.181ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
133182025-05-22T21:29:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133192025-05-22T21:29:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
133202025-05-22T21:29:05.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133212025-05-22T21:29:05.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133222025-05-22T21:29:05.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133232025-05-22T21:29:05.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
133242025-05-22T21:29:05.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133252025-05-22T21:29:05.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133262025-05-22T21:29:05.186ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
133272025-05-22T21:29:05.186ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133282025-05-22T21:29:05.187ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1eba3f3e-6868-4db2-af08-58e6d44df3f2", "content-length": "26", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133292025-05-22T21:29:05.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133302025-05-22T21:29:05.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133312025-05-22T21:29:05.188ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
133322025-05-22T21:29:05.189ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133332025-05-22T21:29:05.189ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62355eca-19e9-4ce3-b30b-48d3b1937233", "content-length": "26", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133342025-05-22T21:29:05.189ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133352025-05-22T21:29:05.190ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133362025-05-22T21:29:05.191ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133372025-05-22T21:29:05.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
133382025-05-22T21:29:05.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133392025-05-22T21:29:05.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133402025-05-22T21:29:05.193ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 107.836885ms iteration = 24 status = 0
133412025-05-22T21:29:05.204ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
133422025-05-22T21:29:05.204ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 118.725316ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
133432025-05-22T21:29:05.215ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
133442025-05-22T21:29:05.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
133452025-05-22T21:29:05.215ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133462025-05-22T21:29:05.215ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133472025-05-22T21:29:05.215ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 129.76766ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133482025-05-22T21:29:05.215ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 129.893052ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133492025-05-22T21:29:05.218ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
133502025-05-22T21:29:05.218ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 132.703135ms iteration = 24 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
133512025-05-22T21:29:05.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133522025-05-22T21:29:05.222ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133532025-05-22T21:29:05.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133542025-05-22T21:29:05.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133552025-05-22T21:29:05.223ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133562025-05-22T21:29:05.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 137.414144ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
133572025-05-22T21:29:05.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 137.390204ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133582025-05-22T21:29:05.224ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133592025-05-22T21:29:05.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133602025-05-22T21:29:05.255ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 168.938824ms iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
133612025-05-22T21:29:05.263ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
133622025-05-22T21:29:05.263ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133632025-05-22T21:29:05.263ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50eea6e5-caf1-4149-9e81-763cc7fd68ae", "content-length": "26", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133642025-05-22T21:29:05.264ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133652025-05-22T21:29:05.265ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
133662025-05-22T21:29:05.268ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133672025-05-22T21:29:05.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133682025-05-22T21:29:05.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133692025-05-22T21:29:05.272ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133702025-05-22T21:29:05.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133712025-05-22T21:29:05.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133722025-05-22T21:29:05.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133732025-05-22T21:29:05.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133742025-05-22T21:29:05.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133752025-05-22T21:29:05.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133762025-05-22T21:29:05.278ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 192.170259ms iteration = 27 status = {"physical_disks_added":0}
133772025-05-22T21:29:05.299ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133782025-05-22T21:29:05.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
133792025-05-22T21:29:05.301ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 214.908788ms iteration = 24 status = null
133802025-05-22T21:29:05.308ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 222.576002ms iteration = 24 status = {}
133812025-05-22T21:29:05.346ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
133822025-05-22T21:29:05.346ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1109ed41-9630-4c30-99de-be3ef8619bdc", "content-length": "691", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133832025-05-22T21:29:05.346ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
133842025-05-22T21:29:05.346ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
133852025-05-22T21:29:05.347ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
133862025-05-22T21:29:05.347ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 261.624923ms iteration = 25 status = {}
133872025-05-22T21:29:05.349ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
133882025-05-22T21:29:05.349ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
133892025-05-22T21:29:05.349ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d460b626-7f5e-4f50-bdea-d0ee6bb9c0ff", "content-length": "372", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133902025-05-22T21:29:05.349ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133912025-05-22T21:29:05.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133922025-05-22T21:29:05.364ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
133932025-05-22T21:29:05.364ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
133942025-05-22T21:29:05.364ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6f6db92a-2aac-4d43-80b7-8005653d1492", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
133952025-05-22T21:29:05.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133962025-05-22T21:29:05.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133972025-05-22T21:29:05.366ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133982025-05-22T21:29:05.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133992025-05-22T21:29:05.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134002025-05-22T21:29:05.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134012025-05-22T21:29:05.373ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
134022025-05-22T21:29:05.373ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134032025-05-22T21:29:05.373ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dbb21e01-8de6-4ac6-856d-54776513c73a", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
134042025-05-22T21:29:05.375ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 288.653026ms iteration = 25 status = {}
134052025-05-22T21:29:05.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134062025-05-22T21:29:05.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134072025-05-22T21:29:05.401ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
134082025-05-22T21:29:05.401ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134092025-05-22T21:29:05.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134102025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
134112025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
134122025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
134132025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
134142025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134152025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134162025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134172025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134182025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134192025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134202025-05-22T21:29:05.412ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
134212025-05-22T21:29:05.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134222025-05-22T21:29:05.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134232025-05-22T21:29:05.415ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
134242025-05-22T21:29:05.415ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134252025-05-22T21:29:05.592ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2fe64eca-f8a7-4687-8f11-50fe17c266bd", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
134262025-05-22T21:29:05.592ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
134272025-05-22T21:29:05.592ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134282025-05-22T21:29:05.593ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9bc3b2da-06d5-4315-8b75-165f2e8add5a", "content-length": "682", "date": "Thu, 22 May 2025 21:29:05 GMT"} })
134292025-05-22T21:29:05.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134302025-05-22T21:29:05.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134312025-05-22T21:29:05.597ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134322025-05-22T21:29:05.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134332025-05-22T21:29:05.600ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134342025-05-22T21:29:05.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134352025-05-22T21:29:05.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134362025-05-22T21:29:05.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134372025-05-22T21:29:05.615ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 529.653451ms iteration = 24 status = {}
134382025-05-22T21:29:05.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48566789-95e0-41d7-abe4-59404052b6f1 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134392025-05-22T21:29:05.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48566789-95e0-41d7-abe4-59404052b6f1 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134402025-05-22T21:29:05.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48566789-95e0-41d7-abe4-59404052b6f1 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134412025-05-22T21:29:06.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be9e636c-3ffb-4497-a98f-ddf48ed74d08 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134422025-05-22T21:29:06.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be9e636c-3ffb-4497-a98f-ddf48ed74d08 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134432025-05-22T21:29:06.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = be9e636c-3ffb-4497-a98f-ddf48ed74d08 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134442025-05-22T21:29:08.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2dd1dd99-8f51-4433-9552-28ecdbfb1a21 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134452025-05-22T21:29:08.000ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2dd1dd99-8f51-4433-9552-28ecdbfb1a21 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134462025-05-22T21:29:08.002ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2416 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2dd1dd99-8f51-4433-9552-28ecdbfb1a21 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134472025-05-22T21:29:08.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 474 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = e2f8ab61-d82d-421f-8c6b-117ccf7db0ad response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
134482025-05-22T21:29:09.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a786a7f1-8eaf-43d4-83d6-5507bf885e87 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134492025-05-22T21:29:09.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a786a7f1-8eaf-43d4-83d6-5507bf885e87 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134502025-05-22T21:29:09.018ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a786a7f1-8eaf-43d4-83d6-5507bf885e87 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134512025-05-22T21:29:10.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0003071f-bb43-40e2-a47f-4e2fda876893 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134522025-05-22T21:29:10.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0003071f-bb43-40e2-a47f-4e2fda876893 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134532025-05-22T21:29:10.034ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0003071f-bb43-40e2-a47f-4e2fda876893 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134542025-05-22T21:29:11.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3f003049-1bbf-4b40-9702-6b2dad3b7805 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134552025-05-22T21:29:11.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3f003049-1bbf-4b40-9702-6b2dad3b7805 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134562025-05-22T21:29:11.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3f003049-1bbf-4b40-9702-6b2dad3b7805 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134572025-05-22T21:29:12.063ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6cbfd31-5afd-46f8-b75e-6de8f621ee88 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134582025-05-22T21:29:12.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6cbfd31-5afd-46f8-b75e-6de8f621ee88 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134592025-05-22T21:29:12.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2492 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6cbfd31-5afd-46f8-b75e-6de8f621ee88 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134602025-05-22T21:29:13.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1ed4d00e-2d80-4984-aaf4-c7bd4438c882 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134612025-05-22T21:29:13.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1ed4d00e-2d80-4984-aaf4-c7bd4438c882 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134622025-05-22T21:29:13.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1ed4d00e-2d80-4984-aaf4-c7bd4438c882 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134632025-05-22T21:29:14.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26a224e4-dd58-47d6-8174-74d5e3da3217 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134642025-05-22T21:29:14.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26a224e4-dd58-47d6-8174-74d5e3da3217 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134652025-05-22T21:29:14.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 26a224e4-dd58-47d6-8174-74d5e3da3217 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134662025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
134672025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134682025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
134692025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134702025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134712025-05-22T21:29:15.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134722025-05-22T21:29:15.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134732025-05-22T21:29:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134742025-05-22T21:29:15.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134752025-05-22T21:29:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134762025-05-22T21:29:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134772025-05-22T21:29:15.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134782025-05-22T21:29:15.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134792025-05-22T21:29:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
134802025-05-22T21:29:15.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134812025-05-22T21:29:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134822025-05-22T21:29:15.108ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
134832025-05-22T21:29:15.108ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.56922ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
134842025-05-22T21:29:15.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9471c85a-f719-44f1-b09f-d0cbda004832 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134852025-05-22T21:29:15.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9471c85a-f719-44f1-b09f-d0cbda004832 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134862025-05-22T21:29:15.113ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2138 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9471c85a-f719-44f1-b09f-d0cbda004832 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134872025-05-22T21:29:15.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134882025-05-22T21:29:15.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134892025-05-22T21:29:15.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.291617ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134902025-05-22T21:29:16.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e75d4049-c526-4606-8535-42771dfaf5e5 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134912025-05-22T21:29:16.127ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e75d4049-c526-4606-8535-42771dfaf5e5 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134922025-05-22T21:29:16.128ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e75d4049-c526-4606-8535-42771dfaf5e5 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134932025-05-22T21:29:17.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28582f76-a3c1-436c-a742-2e3f37adf900 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134942025-05-22T21:29:17.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28582f76-a3c1-436c-a742-2e3f37adf900 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134952025-05-22T21:29:17.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 28582f76-a3c1-436c-a742-2e3f37adf900 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134962025-05-22T21:29:18.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3625a2d8-df34-4380-beca-ba0f90cfa075 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134972025-05-22T21:29:18.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3625a2d8-df34-4380-beca-ba0f90cfa075 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
134982025-05-22T21:29:18.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 476 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = d50e707a-f9d7-4ad5-be1e-806cb013d773 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
134992025-05-22T21:29:18.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2357 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3625a2d8-df34-4380-beca-ba0f90cfa075 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135002025-05-22T21:29:19.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45543262-b298-41c0-96d9-c0bba72a7b60 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135012025-05-22T21:29:19.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45543262-b298-41c0-96d9-c0bba72a7b60 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135022025-05-22T21:29:19.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 45543262-b298-41c0-96d9-c0bba72a7b60 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135032025-05-22T21:29:20.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3de3544-2e50-4581-914e-67b3c5ed8824 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135042025-05-22T21:29:20.191ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3de3544-2e50-4581-914e-67b3c5ed8824 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135052025-05-22T21:29:20.193ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d3de3544-2e50-4581-914e-67b3c5ed8824 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135062025-05-22T21:29:21.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e9df1f8-395d-4b2f-9a6d-b5f7869cff2c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135072025-05-22T21:29:21.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e9df1f8-395d-4b2f-9a6d-b5f7869cff2c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135082025-05-22T21:29:21.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5e9df1f8-395d-4b2f-9a6d-b5f7869cff2c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135092025-05-22T21:29:22.223ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e116da4c-cd67-4f82-8530-df3b47998f62 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135102025-05-22T21:29:22.223ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e116da4c-cd67-4f82-8530-df3b47998f62 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135112025-05-22T21:29:22.225ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2468 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e116da4c-cd67-4f82-8530-df3b47998f62 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135122025-05-22T21:29:23.239ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aca68ec0-d0f8-47fc-a4d5-99471bd35c23 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135132025-05-22T21:29:23.239ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aca68ec0-d0f8-47fc-a4d5-99471bd35c23 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135142025-05-22T21:29:23.241ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = aca68ec0-d0f8-47fc-a4d5-99471bd35c23 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135152025-05-22T21:29:24.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f419ac12-aa6c-4026-ac91-b418372a6c76 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135162025-05-22T21:29:24.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f419ac12-aa6c-4026-ac91-b418372a6c76 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135172025-05-22T21:29:24.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f419ac12-aa6c-4026-ac91-b418372a6c76 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135182025-05-22T21:29:25.085ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
135192025-05-22T21:29:25.085ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
135202025-05-22T21:29:25.085ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135212025-05-22T21:29:25.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135222025-05-22T21:29:25.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135232025-05-22T21:29:25.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135242025-05-22T21:29:25.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135252025-05-22T21:29:25.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135262025-05-22T21:29:25.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135272025-05-22T21:29:25.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.566138ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135282025-05-22T21:29:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135292025-05-22T21:29:25.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135302025-05-22T21:29:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135312025-05-22T21:29:25.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135322025-05-22T21:29:25.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135332025-05-22T21:29:25.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135342025-05-22T21:29:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
135352025-05-22T21:29:25.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135362025-05-22T21:29:25.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135372025-05-22T21:29:25.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
135382025-05-22T21:29:25.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.854015ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
135392025-05-22T21:29:25.269ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05a5f525-95ba-408f-803f-1619a884cd8f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135402025-05-22T21:29:25.269ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05a5f525-95ba-408f-803f-1619a884cd8f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135412025-05-22T21:29:25.271ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 05a5f525-95ba-408f-803f-1619a884cd8f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135422025-05-22T21:29:26.283ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f76c33e3-043b-475a-b53b-cdefd69a7ef7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135432025-05-22T21:29:26.284ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f76c33e3-043b-475a-b53b-cdefd69a7ef7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135442025-05-22T21:29:26.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2247 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f76c33e3-043b-475a-b53b-cdefd69a7ef7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135452025-05-22T21:29:27.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ce7b9211-62f6-4d14-bcac-489dd40f87c6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135462025-05-22T21:29:27.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ce7b9211-62f6-4d14-bcac-489dd40f87c6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135472025-05-22T21:29:27.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ce7b9211-62f6-4d14-bcac-489dd40f87c6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135482025-05-22T21:29:28.160ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 588 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 82205be2-01fb-47ce-93ef-e683f461cb11 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
135492025-05-22T21:29:28.313ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24442736-bac6-47dd-b053-e73934f7e865 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135502025-05-22T21:29:28.313ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24442736-bac6-47dd-b053-e73934f7e865 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135512025-05-22T21:29:28.315ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 24442736-bac6-47dd-b053-e73934f7e865 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135522025-05-22T21:29:29.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3120ea3c-1484-44fd-ba5b-bdf88207eaa3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135532025-05-22T21:29:29.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3120ea3c-1484-44fd-ba5b-bdf88207eaa3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135542025-05-22T21:29:29.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3120ea3c-1484-44fd-ba5b-bdf88207eaa3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135552025-05-22T21:29:30.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4a94e55-0273-43ab-85e1-fb3a73ac1924 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135562025-05-22T21:29:30.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4a94e55-0273-43ab-85e1-fb3a73ac1924 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135572025-05-22T21:29:30.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e4a94e55-0273-43ab-85e1-fb3a73ac1924 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135582025-05-22T21:29:31.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 55df02f7-ee5c-456f-84c6-d670e53cefb4 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135592025-05-22T21:29:31.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 55df02f7-ee5c-456f-84c6-d670e53cefb4 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135602025-05-22T21:29:31.363ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2324 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 55df02f7-ee5c-456f-84c6-d670e53cefb4 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135612025-05-22T21:29:32.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 884ff30b-08be-4a94-a732-aed3192f3ebc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135622025-05-22T21:29:32.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 884ff30b-08be-4a94-a732-aed3192f3ebc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135632025-05-22T21:29:32.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2318 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 884ff30b-08be-4a94-a732-aed3192f3ebc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135642025-05-22T21:29:33.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6e309fc-d469-46dd-91fd-584e360c09b2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135652025-05-22T21:29:33.392ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6e309fc-d469-46dd-91fd-584e360c09b2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135662025-05-22T21:29:33.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2377 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6e309fc-d469-46dd-91fd-584e360c09b2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135672025-05-22T21:29:34.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0912d11b-e369-46d3-8938-1f147eea9015 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135682025-05-22T21:29:34.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0912d11b-e369-46d3-8938-1f147eea9015 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135692025-05-22T21:29:34.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2474 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0912d11b-e369-46d3-8938-1f147eea9015 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
135702025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
135712025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135722025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
135732025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
135742025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135752025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
135762025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
135772025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
135782025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
135792025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
135802025-05-22T21:29:35.086ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:19:35.086702165 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
135812025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
135822025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
135832025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
135842025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
135852025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
135862025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135872025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
135882025-05-22T21:29:35.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
135892025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
135902025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
135912025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135922025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135932025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
135942025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
135952025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
135962025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135972025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
135982025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135992025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
136002025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
136012025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136022025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
136032025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 13 reason = Timeout
136042025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
136052025-05-22T21:29:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
136062025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
136072025-05-22T21:29:35.087ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
136082025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.13\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
136092025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
136102025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
136112025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
136122025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
136132025-05-22T21:29:35.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
136142025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
136152025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136162025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
136172025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
136182025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
136192025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
136202025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
136212025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
136222025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136232025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
136242025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
136252025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 25 reason = Timeout
136262025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136272025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
136282025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136292025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
136302025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
136312025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
136322025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136332025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
136342025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
136352025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
136362025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
136372025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
136382025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
136392025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136402025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 25 reason = Timeout
136412025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
136422025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136432025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
136442025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
136452025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136462025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
136472025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
136482025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
136492025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136502025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
136512025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136522025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
136532025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
136542025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136552025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
136562025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136572025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136582025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136592025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
136602025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136612025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136622025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136632025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
136642025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
136652025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
136662025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
136672025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
136682025-05-22T21:29:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136692025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
136702025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
136712025-05-22T21:29:35.088ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 229370949 } })
136722025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
136732025-05-22T21:29:35.088ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 229507961 } })
136742025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
136752025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
136762025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 13 reason = Timeout
136772025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
136782025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
136792025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
136802025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.600834ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
136812025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
136822025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 2.04703ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
136832025-05-22T21:29:35.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
136842025-05-22T21:29:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
136852025-05-22T21:29:35.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136862025-05-22T21:29:35.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136872025-05-22T21:29:35.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136882025-05-22T21:29:35.096ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.945148ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
136892025-05-22T21:29:35.097ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136902025-05-22T21:29:35.097ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.156196ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
136912025-05-22T21:29:35.098ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:19:35.086702165 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
136922025-05-22T21:29:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.383259ms iteration = 13 status = {"expiration":"2025-05-22T21:19:35.086702165Z","pruned":[]}
136932025-05-22T21:29:35.098ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
136942025-05-22T21:29:35.098ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
136952025-05-22T21:29:35.098ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 11.481411ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
136962025-05-22T21:29:35.099ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 241148604 } })
136972025-05-22T21:29:35.100ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
136982025-05-22T21:29:35.100ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136992025-05-22T21:29:35.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
137002025-05-22T21:29:35.100ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
137012025-05-22T21:29:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
137022025-05-22T21:29:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
137032025-05-22T21:29:35.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137042025-05-22T21:29:35.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137052025-05-22T21:29:35.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137062025-05-22T21:29:35.103ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137072025-05-22T21:29:35.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
137082025-05-22T21:29:35.103ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
137092025-05-22T21:29:35.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137102025-05-22T21:29:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137112025-05-22T21:29:35.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
137122025-05-22T21:29:35.108ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
137132025-05-22T21:29:35.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137142025-05-22T21:29:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137152025-05-22T21:29:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
137162025-05-22T21:29:35.109ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
137172025-05-22T21:29:35.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
137182025-05-22T21:29:35.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137192025-05-22T21:29:35.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137202025-05-22T21:29:35.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137212025-05-22T21:29:35.114ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
137222025-05-22T21:29:35.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
137232025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
137242025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
137252025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
137262025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
137272025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137282025-05-22T21:29:35.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137292025-05-22T21:29:35.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
137302025-05-22T21:29:35.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137312025-05-22T21:29:35.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137322025-05-22T21:29:35.120ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137332025-05-22T21:29:35.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 262183227 } })
137342025-05-22T21:29:35.121ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137352025-05-22T21:29:35.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
137362025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
137372025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
137382025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
137392025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
137402025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
137412025-05-22T21:29:35.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
137422025-05-22T21:29:35.135ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137432025-05-22T21:29:35.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
137442025-05-22T21:29:35.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
137452025-05-22T21:29:35.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
137462025-05-22T21:29:35.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137472025-05-22T21:29:35.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137482025-05-22T21:29:35.143ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137492025-05-22T21:29:35.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137502025-05-22T21:29:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137512025-05-22T21:29:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
137522025-05-22T21:29:35.147ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
137532025-05-22T21:29:35.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
137542025-05-22T21:29:35.147ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
137552025-05-22T21:29:35.147ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 59.547096ms iteration = 13 status = {"by_rx":{},"error":null}
137562025-05-22T21:29:35.153ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137572025-05-22T21:29:35.153ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
137582025-05-22T21:29:35.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137592025-05-22T21:29:35.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
137602025-05-22T21:29:35.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137612025-05-22T21:29:35.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 70.880135ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137622025-05-22T21:29:35.159ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137632025-05-22T21:29:35.159ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
137642025-05-22T21:29:35.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
137652025-05-22T21:29:35.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
137662025-05-22T21:29:35.161ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1684, tv_nsec: 302317324 } })
137672025-05-22T21:29:35.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
137682025-05-22T21:29:35.161ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
137692025-05-22T21:29:35.161ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
137702025-05-22T21:29:35.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
137712025-05-22T21:29:35.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137722025-05-22T21:29:35.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137732025-05-22T21:29:35.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137742025-05-22T21:29:35.167ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
137752025-05-22T21:29:35.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137762025-05-22T21:29:35.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137772025-05-22T21:29:35.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137782025-05-22T21:29:35.171ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 84.973685ms iteration = 13 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
137792025-05-22T21:29:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
137802025-05-22T21:29:35.174ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137812025-05-22T21:29:35.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137822025-05-22T21:29:35.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 97.921767ms iteration = 25 status = {"errors":[],"finish_invoked_ok":[]}
137832025-05-22T21:29:35.187ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 100.11279ms iteration = 25 status = {"errors":[],"requests_created_ok":[]}
137842025-05-22T21:29:35.188ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137852025-05-22T21:29:35.189ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.360464ms iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
137862025-05-22T21:29:35.190ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137872025-05-22T21:29:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137882025-05-22T21:29:35.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
137892025-05-22T21:29:35.191ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137902025-05-22T21:29:35.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137912025-05-22T21:29:35.194ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
137922025-05-22T21:29:35.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
137932025-05-22T21:29:35.194ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137942025-05-22T21:29:35.195ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137952025-05-22T21:29:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137962025-05-22T21:29:35.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
137972025-05-22T21:29:35.197ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
137982025-05-22T21:29:35.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
137992025-05-22T21:29:35.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138002025-05-22T21:29:35.200ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 114.048187ms iteration = 6 status = {"nsuccess":5}
138012025-05-22T21:29:35.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
138022025-05-22T21:29:35.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
138032025-05-22T21:29:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
138042025-05-22T21:29:35.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
138052025-05-22T21:29:35.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
138062025-05-22T21:29:35.206ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
138072025-05-22T21:29:35.206ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
138082025-05-22T21:29:35.206ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
138092025-05-22T21:29:35.206ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138102025-05-22T21:29:35.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138112025-05-22T21:29:35.209ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138122025-05-22T21:29:35.209ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
138132025-05-22T21:29:35.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
138142025-05-22T21:29:35.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138152025-05-22T21:29:35.211ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
138162025-05-22T21:29:35.211ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 124.672464ms iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
138172025-05-22T21:29:35.212ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138182025-05-22T21:29:35.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138192025-05-22T21:29:35.213ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
138202025-05-22T21:29:35.213ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
138212025-05-22T21:29:35.213ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 126.745485ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
138222025-05-22T21:29:35.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
138232025-05-22T21:29:35.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138242025-05-22T21:29:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138252025-05-22T21:29:35.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
138262025-05-22T21:29:35.218ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138272025-05-22T21:29:35.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138282025-05-22T21:29:35.219ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138292025-05-22T21:29:35.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138302025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138312025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
138322025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
138332025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
138342025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 137.08195ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
138352025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
138362025-05-22T21:29:35.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
138372025-05-22T21:29:35.226ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138382025-05-22T21:29:35.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
138392025-05-22T21:29:35.230ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
138402025-05-22T21:29:35.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
138412025-05-22T21:29:35.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
138422025-05-22T21:29:35.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
138432025-05-22T21:29:35.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
138442025-05-22T21:29:35.234ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138452025-05-22T21:29:35.234ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
138462025-05-22T21:29:35.234ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
138472025-05-22T21:29:35.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
138482025-05-22T21:29:35.238ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 148.56084ms iteration = 25 status = 0
138492025-05-22T21:29:35.254ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 166.917744ms iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
138502025-05-22T21:29:35.258ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 171.181927ms iteration = 28 status = {"physical_disks_added":0}
138512025-05-22T21:29:35.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
138522025-05-22T21:29:35.258ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138532025-05-22T21:29:35.259ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9c7114c-2667-42cd-8dff-55a48f265d25", "content-length": "26", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
138542025-05-22T21:29:35.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138552025-05-22T21:29:35.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138562025-05-22T21:29:35.264ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 177.389659ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
138572025-05-22T21:29:35.269ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 183.037593ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
138582025-05-22T21:29:35.274ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
138592025-05-22T21:29:35.274ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
138602025-05-22T21:29:35.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138612025-05-22T21:29:35.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138622025-05-22T21:29:35.276ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138632025-05-22T21:29:35.277ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
138642025-05-22T21:29:35.277ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 190.107059ms iteration = 25 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
138652025-05-22T21:29:35.279ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
138662025-05-22T21:29:35.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138672025-05-22T21:29:35.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138682025-05-22T21:29:35.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138692025-05-22T21:29:35.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138702025-05-22T21:29:35.283ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
138712025-05-22T21:29:35.283ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138722025-05-22T21:29:35.283ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cbfd8d7d-d9e4-4b38-aca5-de2171bd50a2", "content-length": "26", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
138732025-05-22T21:29:35.283ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138742025-05-22T21:29:35.283ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
138752025-05-22T21:29:35.283ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
138762025-05-22T21:29:35.283ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
138772025-05-22T21:29:35.283ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
138782025-05-22T21:29:35.283ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
138792025-05-22T21:29:35.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
138802025-05-22T21:29:35.283ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 196.651716ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
138812025-05-22T21:29:35.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
138822025-05-22T21:29:35.285ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
138832025-05-22T21:29:35.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
138842025-05-22T21:29:35.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
138852025-05-22T21:29:35.289ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138862025-05-22T21:29:35.292ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
138872025-05-22T21:29:35.292ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
138882025-05-22T21:29:35.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
138892025-05-22T21:29:35.308ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
138902025-05-22T21:29:35.308ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
138912025-05-22T21:29:35.309ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fd1fbbc-e7b7-4ccc-ab84-a5519f54ee74", "content-length": "26", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
138922025-05-22T21:29:35.309ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
138932025-05-22T21:29:35.310ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
138942025-05-22T21:29:35.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ef6a4e-e35b-4452-9c80-dc0a57fe9f32 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
138952025-05-22T21:29:35.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ef6a4e-e35b-4452-9c80-dc0a57fe9f32 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
138962025-05-22T21:29:35.471ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
138972025-05-22T21:29:35.529ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
138982025-05-22T21:29:35.530ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d9d3071d-1152-43ca-81e8-3a26d83199b9", "date": "Thu, 22 May 2025 21:29:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138992025-05-22T21:29:35.530ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
139002025-05-22T21:29:35.532ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "3cef1628-0f02-40cd-89ff-2b219c3eb501", "date": "Thu, 22 May 2025 21:29:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
139012025-05-22T21:29:35.532ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
139022025-05-22T21:29:35.534ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
139032025-05-22T21:29:35.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 448.080748ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
139042025-05-22T21:29:35.557ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 470.3713ms iteration = 25 status = {}
139052025-05-22T21:29:35.570ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
139062025-05-22T21:29:35.570ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
139072025-05-22T21:29:35.571ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef4d7884-8629-42c8-b9c8-e0802bef3a17", "content-length": "372", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
139082025-05-22T21:29:35.571ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139092025-05-22T21:29:35.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139102025-05-22T21:29:35.573ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
139112025-05-22T21:29:35.573ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
139122025-05-22T21:29:35.573ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
139132025-05-22T21:29:35.573ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 486.683782ms iteration = 13 status = {"generation":1}
139142025-05-22T21:29:35.574ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139152025-05-22T21:29:35.576ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139162025-05-22T21:29:35.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139172025-05-22T21:29:35.577ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 153412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ef6a4e-e35b-4452-9c80-dc0a57fe9f32 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
139182025-05-22T21:29:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
139192025-05-22T21:29:35.579ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139202025-05-22T21:29:35.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139212025-05-22T21:29:35.582ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 495.791767ms iteration = 25 status = null
139222025-05-22T21:29:35.634ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
139232025-05-22T21:29:35.634ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b0ce873c-61d6-46a7-afb7-672359e74865", "date": "Thu, 22 May 2025 21:29:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139242025-05-22T21:29:35.634ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139252025-05-22T21:29:35.637ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8933dc23-e505-4b9d-aa8c-324937dc5561", "date": "Thu, 22 May 2025 21:29:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139262025-05-22T21:29:35.637ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139272025-05-22T21:29:35.639ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "63678c2e-91d3-46ca-921f-5859f0fec160", "date": "Thu, 22 May 2025 21:29:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139282025-05-22T21:29:35.639ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139292025-05-22T21:29:35.641ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
139302025-05-22T21:29:35.641ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 554.495141ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
139312025-05-22T21:29:35.641ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
139322025-05-22T21:29:35.641ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
139332025-05-22T21:29:35.641ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139342025-05-22T21:29:35.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139352025-05-22T21:29:35.649ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139362025-05-22T21:29:35.652ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
139372025-05-22T21:29:35.652ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
139382025-05-22T21:29:35.652ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
139392025-05-22T21:29:35.652ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 565.675317ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
139402025-05-22T21:29:35.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
139412025-05-22T21:29:35.654ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
139422025-05-22T21:29:35.654ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
139432025-05-22T21:29:35.654ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
139442025-05-22T21:29:35.654ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 567.611107ms iteration = 13 status = {"generation":2}
139452025-05-22T21:29:35.663ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
139462025-05-22T21:29:35.663ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
139472025-05-22T21:29:35.663ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "590db264-cceb-4d13-aa84-64806eed3108", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
139482025-05-22T21:29:35.663ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139492025-05-22T21:29:35.664ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139502025-05-22T21:29:35.666ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139512025-05-22T21:29:35.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139522025-05-22T21:29:35.669ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139532025-05-22T21:29:35.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139542025-05-22T21:29:35.672ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
139552025-05-22T21:29:35.672ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
139562025-05-22T21:29:35.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139572025-05-22T21:29:35.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139582025-05-22T21:29:35.701ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
139592025-05-22T21:29:35.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139602025-05-22T21:29:35.702ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139612025-05-22T21:29:35.710ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
139622025-05-22T21:29:35.710ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 623.62681ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
139632025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
139642025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
139652025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
139662025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
139672025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139682025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139692025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139702025-05-22T21:29:35.713ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139712025-05-22T21:29:35.714ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
139722025-05-22T21:29:35.714ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
139732025-05-22T21:29:35.714ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
139742025-05-22T21:29:35.714ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139752025-05-22T21:29:35.714ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139762025-05-22T21:29:35.715ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139772025-05-22T21:29:35.716ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
139782025-05-22T21:29:35.716ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
139792025-05-22T21:29:35.716ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139802025-05-22T21:29:35.718ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139812025-05-22T21:29:35.720ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
139822025-05-22T21:29:35.720ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139832025-05-22T21:29:35.720ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139842025-05-22T21:29:35.722ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139852025-05-22T21:29:35.724ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
139862025-05-22T21:29:35.725ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139872025-05-22T21:29:35.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139882025-05-22T21:29:35.783ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c9844ff4-af85-44d1-bcd4-8874ee7963b4", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
139892025-05-22T21:29:35.785ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 698.703038ms iteration = 26 status = {}
139902025-05-22T21:29:35.822ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
139912025-05-22T21:29:35.823ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "959eaf23-886d-407d-b8cd-37dcaf6d2e53", "content-length": "691", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
139922025-05-22T21:29:35.823ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
139932025-05-22T21:29:35.823ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
139942025-05-22T21:29:35.823ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
139952025-05-22T21:29:35.825ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 738.143484ms iteration = 26 status = {}
139962025-05-22T21:29:35.885ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "3b5c82ee-f6b9-4329-a34e-a9f84b89b123", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
139972025-05-22T21:29:35.885ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
139982025-05-22T21:29:35.885ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
139992025-05-22T21:29:35.886ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "6de36958-762d-4762-ad2a-b91bad25f83b", "content-length": "682", "date": "Thu, 22 May 2025 21:29:35 GMT"} })
140002025-05-22T21:29:35.886ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140012025-05-22T21:29:35.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140022025-05-22T21:29:35.889ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140032025-05-22T21:29:35.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140042025-05-22T21:29:35.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140052025-05-22T21:29:35.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140062025-05-22T21:29:35.895ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140072025-05-22T21:29:35.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140082025-05-22T21:29:35.903ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 816.230266ms iteration = 25 status = {}
140092025-05-22T21:29:36.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04b44c4a-223f-43a9-a795-d2958820d1ae roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140102025-05-22T21:29:36.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04b44c4a-223f-43a9-a795-d2958820d1ae resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140112025-05-22T21:29:36.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 04b44c4a-223f-43a9-a795-d2958820d1ae response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140122025-05-22T21:29:37.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae2023f5-1366-4dc1-99a7-f47d0b752c4d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140132025-05-22T21:29:37.609ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae2023f5-1366-4dc1-99a7-f47d0b752c4d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140142025-05-22T21:29:37.610ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ae2023f5-1366-4dc1-99a7-f47d0b752c4d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140152025-05-22T21:29:38.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 576 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 00096c27-f394-4e56-ba5c-85fb85a874ff response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
140162025-05-22T21:29:38.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2cc4daa0-d0b4-49ae-9e62-a73efdc0b3da roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140172025-05-22T21:29:38.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2cc4daa0-d0b4-49ae-9e62-a73efdc0b3da resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140182025-05-22T21:29:38.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2cc4daa0-d0b4-49ae-9e62-a73efdc0b3da response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140192025-05-22T21:29:39.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b82857e8-ef6f-4a7a-88b9-6ee3c83e8c09 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140202025-05-22T21:29:39.640ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b82857e8-ef6f-4a7a-88b9-6ee3c83e8c09 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140212025-05-22T21:29:39.642ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2618 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b82857e8-ef6f-4a7a-88b9-6ee3c83e8c09 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140222025-05-22T21:29:40.656ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37de287e-1b86-4244-85c9-0c482cf55ce7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140232025-05-22T21:29:40.656ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37de287e-1b86-4244-85c9-0c482cf55ce7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140242025-05-22T21:29:40.658ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2718 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37de287e-1b86-4244-85c9-0c482cf55ce7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140252025-05-22T21:29:41.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9510398e-62d2-4ca8-8a19-ce663a30ae09 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140262025-05-22T21:29:41.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9510398e-62d2-4ca8-8a19-ce663a30ae09 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140272025-05-22T21:29:41.673ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1786 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9510398e-62d2-4ca8-8a19-ce663a30ae09 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140282025-05-22T21:29:42.688ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b554356c-a7f1-405d-b0e9-fa4577962664 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140292025-05-22T21:29:42.688ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b554356c-a7f1-405d-b0e9-fa4577962664 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140302025-05-22T21:29:42.690ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b554356c-a7f1-405d-b0e9-fa4577962664 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140312025-05-22T21:29:43.704ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f29f594f-cf70-4db0-a25b-28c54a3707c2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140322025-05-22T21:29:43.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f29f594f-cf70-4db0-a25b-28c54a3707c2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140332025-05-22T21:29:43.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2436 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f29f594f-cf70-4db0-a25b-28c54a3707c2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140342025-05-22T21:29:44.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ace3bbba-8eef-44ab-a98a-9b6759ceb94b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140352025-05-22T21:29:44.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ace3bbba-8eef-44ab-a98a-9b6759ceb94b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140362025-05-22T21:29:44.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ace3bbba-8eef-44ab-a98a-9b6759ceb94b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140372025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
140382025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
140392025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140402025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140412025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140422025-05-22T21:29:45.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140432025-05-22T21:29:45.088ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140442025-05-22T21:29:45.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
140452025-05-22T21:29:45.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140462025-05-22T21:29:45.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140472025-05-22T21:29:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140482025-05-22T21:29:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140492025-05-22T21:29:45.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140502025-05-22T21:29:45.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140512025-05-22T21:29:45.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140522025-05-22T21:29:45.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
140532025-05-22T21:29:45.128ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140542025-05-22T21:29:45.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140552025-05-22T21:29:45.138ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
140562025-05-22T21:29:45.138ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.46672ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
140572025-05-22T21:29:45.147ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.053618ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140582025-05-22T21:29:45.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a1d2f65-af3c-462d-96a8-3488f828115f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140592025-05-22T21:29:45.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a1d2f65-af3c-462d-96a8-3488f828115f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140602025-05-22T21:29:45.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3a1d2f65-af3c-462d-96a8-3488f828115f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140612025-05-22T21:29:46.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b901ed13-832a-4819-a74e-818bd5630ccc roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140622025-05-22T21:29:46.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b901ed13-832a-4819-a74e-818bd5630ccc resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140632025-05-22T21:29:46.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b901ed13-832a-4819-a74e-818bd5630ccc response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140642025-05-22T21:29:47.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e6ba46c-76db-4472-9e41-5c39af904e6c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140652025-05-22T21:29:47.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e6ba46c-76db-4472-9e41-5c39af904e6c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140662025-05-22T21:29:47.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0e6ba46c-76db-4472-9e41-5c39af904e6c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140672025-05-22T21:29:48.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 65b25648-1523-4a73-a941-907b1738ba04 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
140682025-05-22T21:29:48.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e0281de2-c07f-4480-af85-b941aa924810 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140692025-05-22T21:29:48.786ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e0281de2-c07f-4480-af85-b941aa924810 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140702025-05-22T21:29:48.788ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2572 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e0281de2-c07f-4480-af85-b941aa924810 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140712025-05-22T21:29:49.801ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d48c2c9-bbb5-4deb-8ecf-b07774e5dbbd roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140722025-05-22T21:29:49.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d48c2c9-bbb5-4deb-8ecf-b07774e5dbbd resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140732025-05-22T21:29:49.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6d48c2c9-bbb5-4deb-8ecf-b07774e5dbbd response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140742025-05-22T21:29:50.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94be9d4c-2eec-45d7-8623-c44af3e6e713 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140752025-05-22T21:29:50.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94be9d4c-2eec-45d7-8623-c44af3e6e713 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140762025-05-22T21:29:50.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2845 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 94be9d4c-2eec-45d7-8623-c44af3e6e713 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140772025-05-22T21:29:51.833ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31d6fc9c-11b4-4744-8a32-af587203d962 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140782025-05-22T21:29:51.834ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31d6fc9c-11b4-4744-8a32-af587203d962 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140792025-05-22T21:29:51.836ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 31d6fc9c-11b4-4744-8a32-af587203d962 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140802025-05-22T21:29:52.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19525e86-9b21-4671-8cdd-939e76df68b6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140812025-05-22T21:29:52.849ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19525e86-9b21-4671-8cdd-939e76df68b6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140822025-05-22T21:29:52.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19525e86-9b21-4671-8cdd-939e76df68b6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140832025-05-22T21:29:53.865ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 84453398-7153-4c99-b30c-adbab9fc6f86 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140842025-05-22T21:29:53.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 84453398-7153-4c99-b30c-adbab9fc6f86 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140852025-05-22T21:29:53.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 84453398-7153-4c99-b30c-adbab9fc6f86 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140862025-05-22T21:29:54.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5bcdc2f-3883-4923-8d5f-7b10df8749ad roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140872025-05-22T21:29:54.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5bcdc2f-3883-4923-8d5f-7b10df8749ad resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140882025-05-22T21:29:54.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2412 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5bcdc2f-3883-4923-8d5f-7b10df8749ad response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
140892025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
140902025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
140912025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140922025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140932025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140942025-05-22T21:29:55.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140952025-05-22T21:29:55.088ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140962025-05-22T21:29:55.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140972025-05-22T21:29:55.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140982025-05-22T21:29:55.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.199399ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140992025-05-22T21:29:55.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141002025-05-22T21:29:55.121ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141012025-05-22T21:29:55.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141022025-05-22T21:29:55.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141032025-05-22T21:29:55.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141042025-05-22T21:29:55.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141052025-05-22T21:29:55.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
141062025-05-22T21:29:55.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141072025-05-22T21:29:55.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141082025-05-22T21:29:55.136ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
141092025-05-22T21:29:55.136ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.465246ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
141102025-05-22T21:29:55.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98bc3d28-81cb-4ffe-966f-5ff75116e5d7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141112025-05-22T21:29:55.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98bc3d28-81cb-4ffe-966f-5ff75116e5d7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141122025-05-22T21:29:55.898ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 98bc3d28-81cb-4ffe-966f-5ff75116e5d7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141132025-05-22T21:29:56.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3c6b8eb-501f-4114-a751-1277cbf709eb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141142025-05-22T21:29:56.913ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3c6b8eb-501f-4114-a751-1277cbf709eb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141152025-05-22T21:29:56.915ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2652 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b3c6b8eb-501f-4114-a751-1277cbf709eb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141162025-05-22T21:29:57.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ae49db-1a78-4a69-bfb3-db0d7b342745 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141172025-05-22T21:29:57.930ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ae49db-1a78-4a69-bfb3-db0d7b342745 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141182025-05-22T21:29:57.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2269 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 19ae49db-1a78-4a69-bfb3-db0d7b342745 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141192025-05-22T21:29:58.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 823 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = b9e19d0e-7564-4943-9eb0-87450231383d response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
141202025-05-22T21:29:58.945ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93472a91-0235-4f76-85c9-9a653a517164 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141212025-05-22T21:29:58.945ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93472a91-0235-4f76-85c9-9a653a517164 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141222025-05-22T21:29:58.947ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 93472a91-0235-4f76-85c9-9a653a517164 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141232025-05-22T21:29:59.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2299ca95-7385-4712-859a-1317a482b750 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141242025-05-22T21:29:59.962ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2299ca95-7385-4712-859a-1317a482b750 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141252025-05-22T21:29:59.964ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2699 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 2299ca95-7385-4712-859a-1317a482b750 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141262025-05-22T21:30:00.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028a1a12-ffd7-48f7-89d8-9632500f00ca roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141272025-05-22T21:30:00.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028a1a12-ffd7-48f7-89d8-9632500f00ca resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141282025-05-22T21:30:00.979ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1744 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 028a1a12-ffd7-48f7-89d8-9632500f00ca response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141292025-05-22T21:30:01.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e908e46-b6e5-487b-89ae-639b189241b2 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141302025-05-22T21:30:01.994ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e908e46-b6e5-487b-89ae-639b189241b2 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141312025-05-22T21:30:01.996ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3e908e46-b6e5-487b-89ae-639b189241b2 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141322025-05-22T21:30:03.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3649f4cb-03e9-468f-bfca-3c37604c4966 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141332025-05-22T21:30:03.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3649f4cb-03e9-468f-bfca-3c37604c4966 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141342025-05-22T21:30:03.012ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3649f4cb-03e9-468f-bfca-3c37604c4966 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141352025-05-22T21:30:04.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49547669-d00f-464b-889f-2c97743b4b37 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141362025-05-22T21:30:04.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49547669-d00f-464b-889f-2c97743b4b37 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141372025-05-22T21:30:04.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2347 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 49547669-d00f-464b-889f-2c97743b4b37 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141382025-05-22T21:30:05.042ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bf92417e-6813-4a2d-a1cf-9464367f0525 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141392025-05-22T21:30:05.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bf92417e-6813-4a2d-a1cf-9464367f0525 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141402025-05-22T21:30:05.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bf92417e-6813-4a2d-a1cf-9464367f0525 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
141412025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
141422025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
141432025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
141442025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141452025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
141462025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
141472025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
141482025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
141492025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141502025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141512025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 26 reason = Timeout
141522025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
141532025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
141542025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
141552025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
141562025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
141572025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
141582025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
141592025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
141602025-05-22T21:30:05.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
141612025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
141622025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
141632025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
141642025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
141652025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
141662025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
141672025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
141682025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141692025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
141702025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141712025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141722025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
141732025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
141742025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
141752025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 26 reason = Timeout
141762025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
141772025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
141782025-05-22T21:30:05.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
141792025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141802025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
141812025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
141822025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141832025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
141842025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
141852025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141862025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141872025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
141882025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
141892025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141902025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
141912025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
141922025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
141932025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141942025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141952025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
141962025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141972025-05-22T21:30:05.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
141982025-05-22T21:30:05.091ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141992025-05-22T21:30:05.092ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.270439ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
142002025-05-22T21:30:05.093ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142012025-05-22T21:30:05.094ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 235397185 } })
142022025-05-22T21:30:05.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142032025-05-22T21:30:05.094ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
142042025-05-22T21:30:05.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
142052025-05-22T21:30:05.095ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142062025-05-22T21:30:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142072025-05-22T21:30:05.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
142082025-05-22T21:30:05.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142092025-05-22T21:30:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142102025-05-22T21:30:05.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142112025-05-22T21:30:05.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142122025-05-22T21:30:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142132025-05-22T21:30:05.098ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142142025-05-22T21:30:05.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142152025-05-22T21:30:05.099ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142162025-05-22T21:30:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
142172025-05-22T21:30:05.102ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142182025-05-22T21:30:05.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142192025-05-22T21:30:05.102ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142202025-05-22T21:30:05.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
142212025-05-22T21:30:05.106ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142222025-05-22T21:30:05.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142232025-05-22T21:30:05.106ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142242025-05-22T21:30:05.107ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142252025-05-22T21:30:05.107ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 248913037 } })
142262025-05-22T21:30:05.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142272025-05-22T21:30:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142282025-05-22T21:30:05.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
142292025-05-22T21:30:05.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142302025-05-22T21:30:05.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
142312025-05-22T21:30:05.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142322025-05-22T21:30:05.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
142332025-05-22T21:30:05.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142342025-05-22T21:30:05.117ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
142352025-05-22T21:30:05.117ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142362025-05-22T21:30:05.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142372025-05-22T21:30:05.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1714, tv_nsec: 258748003 } })
142382025-05-22T21:30:05.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
142392025-05-22T21:30:05.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142402025-05-22T21:30:05.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142412025-05-22T21:30:05.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 50.921997ms iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
142422025-05-22T21:30:05.142ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
142432025-05-22T21:30:05.142ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
142442025-05-22T21:30:05.142ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142452025-05-22T21:30:05.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142462025-05-22T21:30:05.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142472025-05-22T21:30:05.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142482025-05-22T21:30:05.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
142492025-05-22T21:30:05.153ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142502025-05-22T21:30:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
142512025-05-22T21:30:05.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142522025-05-22T21:30:05.154ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142532025-05-22T21:30:05.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142542025-05-22T21:30:05.156ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
142552025-05-22T21:30:05.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142562025-05-22T21:30:05.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
142572025-05-22T21:30:05.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.083638ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142582025-05-22T21:30:05.158ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142592025-05-22T21:30:05.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142602025-05-22T21:30:05.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.057677ms iteration = 26 status = {"errors":[],"finish_invoked_ok":[]}
142612025-05-22T21:30:05.160ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142622025-05-22T21:30:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
142632025-05-22T21:30:05.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142642025-05-22T21:30:05.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142652025-05-22T21:30:05.161ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 75.005057ms iteration = 26 status = {"errors":[],"requests_created_ok":[]}
142662025-05-22T21:30:05.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142672025-05-22T21:30:05.162ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 75.93218ms iteration = 26 status = 0
142682025-05-22T21:30:05.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
142692025-05-22T21:30:05.163ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
142702025-05-22T21:30:05.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
142712025-05-22T21:30:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
142722025-05-22T21:30:05.164ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142732025-05-22T21:30:05.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
142742025-05-22T21:30:05.165ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
142752025-05-22T21:30:05.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
142762025-05-22T21:30:05.167ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 80.491698ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
142772025-05-22T21:30:05.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142782025-05-22T21:30:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
142792025-05-22T21:30:05.174ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142802025-05-22T21:30:05.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
142812025-05-22T21:30:05.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142822025-05-22T21:30:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
142832025-05-22T21:30:05.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142842025-05-22T21:30:05.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142852025-05-22T21:30:05.181ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
142862025-05-22T21:30:05.181ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.623758ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
142872025-05-22T21:30:05.191ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
142882025-05-22T21:30:05.191ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 104.462755ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
142892025-05-22T21:30:05.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.57027ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
142902025-05-22T21:30:05.195ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 108.88866ms iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
142912025-05-22T21:30:05.200ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
142922025-05-22T21:30:05.200ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
142932025-05-22T21:30:05.200ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142942025-05-22T21:30:05.200ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
142952025-05-22T21:30:05.200ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 113.62407ms iteration = 26 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
142962025-05-22T21:30:05.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142972025-05-22T21:30:05.224ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
142982025-05-22T21:30:05.224ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
142992025-05-22T21:30:05.225ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "308f2a2a-d7d7-4186-b462-6e5017497fcb", "content-length": "26", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143002025-05-22T21:30:05.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
143012025-05-22T21:30:05.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
143022025-05-22T21:30:05.239ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143032025-05-22T21:30:05.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143042025-05-22T21:30:05.240ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143052025-05-22T21:30:05.240ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
143062025-05-22T21:30:05.240ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 153.93038ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
143072025-05-22T21:30:05.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
143082025-05-22T21:30:05.280ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
143092025-05-22T21:30:05.281ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6801050e-60ce-4b58-b2a4-3a4134718175", "content-length": "26", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143102025-05-22T21:30:05.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
143112025-05-22T21:30:05.282ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
143122025-05-22T21:30:05.282ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
143132025-05-22T21:30:05.282ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4dd636b-c20e-4ae9-9683-7de6e58f1db3", "content-length": "26", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143142025-05-22T21:30:05.282ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
143152025-05-22T21:30:05.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
143162025-05-22T21:30:05.284ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
143172025-05-22T21:30:05.294ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 207.428226ms iteration = 29 status = {"physical_disks_added":0}
143182025-05-22T21:30:05.352ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143192025-05-22T21:30:05.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143202025-05-22T21:30:05.354ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143212025-05-22T21:30:05.356ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
143222025-05-22T21:30:05.356ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143232025-05-22T21:30:05.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143242025-05-22T21:30:05.357ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143252025-05-22T21:30:05.360ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
143262025-05-22T21:30:05.360ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143272025-05-22T21:30:05.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143282025-05-22T21:30:05.500ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
143292025-05-22T21:30:05.500ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
143302025-05-22T21:30:05.501ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "67afff3e-5dbc-4053-ae21-6514272818fb", "content-length": "372", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143312025-05-22T21:30:05.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143322025-05-22T21:30:05.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143332025-05-22T21:30:05.546ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
143342025-05-22T21:30:05.547ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "685e52a2-b016-4e8b-bcfe-a5ef8d9cd6e3", "content-length": "691", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143352025-05-22T21:30:05.547ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
143362025-05-22T21:30:05.547ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
143372025-05-22T21:30:05.547ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
143382025-05-22T21:30:05.549ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 463.02784ms iteration = 27 status = {}
143392025-05-22T21:30:05.558ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
143402025-05-22T21:30:05.558ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
143412025-05-22T21:30:05.558ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ca360095-0e0b-4c34-b232-7d93e01e94b9", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143422025-05-22T21:30:05.558ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143432025-05-22T21:30:05.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143442025-05-22T21:30:05.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143452025-05-22T21:30:05.561ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143462025-05-22T21:30:05.562ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
143472025-05-22T21:30:05.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
143482025-05-22T21:30:05.564ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143492025-05-22T21:30:05.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143502025-05-22T21:30:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143512025-05-22T21:30:05.564ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 478.041623ms iteration = 26 status = null
143522025-05-22T21:30:05.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143532025-05-22T21:30:05.567ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
143542025-05-22T21:30:05.567ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
143552025-05-22T21:30:05.567ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
143562025-05-22T21:30:05.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143572025-05-22T21:30:05.567ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "281da4bb-e948-4629-8a13-0ef9a96bedd2", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143582025-05-22T21:30:05.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143592025-05-22T21:30:05.569ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 482.182145ms iteration = 27 status = {}
143602025-05-22T21:30:05.570ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 483.347662ms iteration = 26 status = {}
143612025-05-22T21:30:05.579ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
143622025-05-22T21:30:05.579ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
143632025-05-22T21:30:05.579ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
143642025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
143652025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
143662025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
143672025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
143682025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
143692025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
143702025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
143712025-05-22T21:30:05.580ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
143722025-05-22T21:30:05.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143732025-05-22T21:30:05.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143742025-05-22T21:30:05.582ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
143752025-05-22T21:30:05.582ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
143762025-05-22T21:30:05.736ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e2163d19-d550-449a-9c58-ac889deb920d", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143772025-05-22T21:30:05.736ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
143782025-05-22T21:30:05.736ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
143792025-05-22T21:30:05.737ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c406cdb1-43fc-4c7c-a281-15567b0db46a", "content-length": "682", "date": "Thu, 22 May 2025 21:30:05 GMT"} })
143802025-05-22T21:30:05.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143812025-05-22T21:30:05.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143822025-05-22T21:30:05.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143832025-05-22T21:30:05.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143842025-05-22T21:30:05.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143852025-05-22T21:30:05.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143862025-05-22T21:30:05.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143872025-05-22T21:30:05.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143882025-05-22T21:30:05.758ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 671.082787ms iteration = 26 status = {}
143892025-05-22T21:30:06.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9866bc0e-97f8-488e-91b1-f0909b70457f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143902025-05-22T21:30:06.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9866bc0e-97f8-488e-91b1-f0909b70457f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143912025-05-22T21:30:06.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2150 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 9866bc0e-97f8-488e-91b1-f0909b70457f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143922025-05-22T21:30:07.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5f769a0-33d4-49c9-86fd-b7598f9a1232 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143932025-05-22T21:30:07.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5f769a0-33d4-49c9-86fd-b7598f9a1232 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143942025-05-22T21:30:07.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2490 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f5f769a0-33d4-49c9-86fd-b7598f9a1232 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143952025-05-22T21:30:08.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e95ada51-b44f-48b7-adb3-46ba93aee16c roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143962025-05-22T21:30:08.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e95ada51-b44f-48b7-adb3-46ba93aee16c resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143972025-05-22T21:30:08.093ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e95ada51-b44f-48b7-adb3-46ba93aee16c response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
143982025-05-22T21:30:08.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 603 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 8f90938d-2d37-4987-bfdf-964f04dc0e37 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
143992025-05-22T21:30:09.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48b06079-a959-4f4d-9403-1869780fa55e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144002025-05-22T21:30:09.106ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48b06079-a959-4f4d-9403-1869780fa55e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144012025-05-22T21:30:09.108ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 48b06079-a959-4f4d-9403-1869780fa55e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144022025-05-22T21:30:10.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8503b78c-9a5e-41d9-a4fd-230e7aa4c417 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144032025-05-22T21:30:10.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8503b78c-9a5e-41d9-a4fd-230e7aa4c417 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144042025-05-22T21:30:10.125ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8503b78c-9a5e-41d9-a4fd-230e7aa4c417 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144052025-05-22T21:30:11.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c097e495-68cd-43d0-b6ec-352478bd96aa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144062025-05-22T21:30:11.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c097e495-68cd-43d0-b6ec-352478bd96aa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144072025-05-22T21:30:11.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1859 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c097e495-68cd-43d0-b6ec-352478bd96aa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144082025-05-22T21:30:12.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f913991a-925f-4166-b19c-90e52737b660 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144092025-05-22T21:30:12.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f913991a-925f-4166-b19c-90e52737b660 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144102025-05-22T21:30:12.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2827 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = f913991a-925f-4166-b19c-90e52737b660 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144112025-05-22T21:30:13.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c979f9c7-57a8-488d-b9a0-3d865a341ab7 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144122025-05-22T21:30:13.170ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c979f9c7-57a8-488d-b9a0-3d865a341ab7 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144132025-05-22T21:30:13.172ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c979f9c7-57a8-488d-b9a0-3d865a341ab7 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144142025-05-22T21:30:14.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77c87bc-a69f-4629-954f-f9d6b036e9ef roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144152025-05-22T21:30:14.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77c87bc-a69f-4629-954f-f9d6b036e9ef resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144162025-05-22T21:30:14.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2759 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c77c87bc-a69f-4629-954f-f9d6b036e9ef response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144172025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
144182025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
144192025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144202025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144212025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144222025-05-22T21:30:15.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144232025-05-22T21:30:15.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144242025-05-22T21:30:15.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144252025-05-22T21:30:15.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144262025-05-22T21:30:15.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.098531ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
144272025-05-22T21:30:15.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
144282025-05-22T21:30:15.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144292025-05-22T21:30:15.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144302025-05-22T21:30:15.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144312025-05-22T21:30:15.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144322025-05-22T21:30:15.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144332025-05-22T21:30:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
144342025-05-22T21:30:15.097ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144352025-05-22T21:30:15.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144362025-05-22T21:30:15.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
144372025-05-22T21:30:15.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.510061ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
144382025-05-22T21:30:15.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1def09f0-0c0a-44f3-9155-2cd5abd5afcb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144392025-05-22T21:30:15.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1def09f0-0c0a-44f3-9155-2cd5abd5afcb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144402025-05-22T21:30:15.203ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1640 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1def09f0-0c0a-44f3-9155-2cd5abd5afcb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144412025-05-22T21:30:16.216ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37b2e328-e7c4-40de-a7b8-d833a4ae8d9b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144422025-05-22T21:30:16.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37b2e328-e7c4-40de-a7b8-d833a4ae8d9b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144432025-05-22T21:30:16.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 37b2e328-e7c4-40de-a7b8-d833a4ae8d9b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144442025-05-22T21:30:17.231ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673c2997-7083-43bd-ad3a-a219795146a6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144452025-05-22T21:30:17.231ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673c2997-7083-43bd-ad3a-a219795146a6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144462025-05-22T21:30:17.233ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2677 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 673c2997-7083-43bd-ad3a-a219795146a6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144472025-05-22T21:30:18.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 594 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = acec7c2b-ef80-4f85-afe8-1ecfa0d8e9f8 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
144482025-05-22T21:30:18.247ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd043056-bb67-447c-88c1-e41b014e9b5a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144492025-05-22T21:30:18.247ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd043056-bb67-447c-88c1-e41b014e9b5a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144502025-05-22T21:30:18.249ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = bd043056-bb67-447c-88c1-e41b014e9b5a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144512025-05-22T21:30:19.262ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b409589-286d-4bb9-8c3c-dfa6eff2fe3e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144522025-05-22T21:30:19.263ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b409589-286d-4bb9-8c3c-dfa6eff2fe3e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144532025-05-22T21:30:19.265ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3b409589-286d-4bb9-8c3c-dfa6eff2fe3e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144542025-05-22T21:30:20.278ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1d5b22a5-80c9-4b6b-bdfe-35fe3b5559d6 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144552025-05-22T21:30:20.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1d5b22a5-80c9-4b6b-bdfe-35fe3b5559d6 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144562025-05-22T21:30:20.280ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 1d5b22a5-80c9-4b6b-bdfe-35fe3b5559d6 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144572025-05-22T21:30:21.293ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ee85722-ff07-470b-99fb-894f9179f2fb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144582025-05-22T21:30:21.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ee85722-ff07-470b-99fb-894f9179f2fb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144592025-05-22T21:30:21.295ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2630 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 0ee85722-ff07-470b-99fb-894f9179f2fb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144602025-05-22T21:30:22.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c92d0927-8ae4-46cc-b22a-02a429a8fe2e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144612025-05-22T21:30:22.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c92d0927-8ae4-46cc-b22a-02a429a8fe2e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144622025-05-22T21:30:22.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c92d0927-8ae4-46cc-b22a-02a429a8fe2e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144632025-05-22T21:30:23.325ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee581e8f-e581-42c0-8603-f74752dfd6c8 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144642025-05-22T21:30:23.326ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee581e8f-e581-42c0-8603-f74752dfd6c8 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144652025-05-22T21:30:23.328ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = ee581e8f-e581-42c0-8603-f74752dfd6c8 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144662025-05-22T21:30:24.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6494596-e749-403a-9482-293078a3456a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144672025-05-22T21:30:24.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6494596-e749-403a-9482-293078a3456a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144682025-05-22T21:30:24.344ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2641 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b6494596-e749-403a-9482-293078a3456a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144692025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
144702025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
144712025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144722025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144732025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144742025-05-22T21:30:25.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144752025-05-22T21:30:25.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144762025-05-22T21:30:25.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
144772025-05-22T21:30:25.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
144782025-05-22T21:30:25.091ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.501547ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
144792025-05-22T21:30:25.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
144802025-05-22T21:30:25.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144812025-05-22T21:30:25.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144822025-05-22T21:30:25.094ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144832025-05-22T21:30:25.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144842025-05-22T21:30:25.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144852025-05-22T21:30:25.098ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
144862025-05-22T21:30:25.098ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
144872025-05-22T21:30:25.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
144882025-05-22T21:30:25.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
144892025-05-22T21:30:25.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.035143ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
144902025-05-22T21:30:25.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16bf61a8-815f-4cc0-bbce-1a13ef2ded14 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144912025-05-22T21:30:25.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16bf61a8-815f-4cc0-bbce-1a13ef2ded14 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144922025-05-22T21:30:25.360ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 16bf61a8-815f-4cc0-bbce-1a13ef2ded14 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144932025-05-22T21:30:26.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 340f65e3-d7c2-4046-bbf7-3814e606957f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144942025-05-22T21:30:26.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 340f65e3-d7c2-4046-bbf7-3814e606957f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144952025-05-22T21:30:26.375ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2472 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 340f65e3-d7c2-4046-bbf7-3814e606957f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144962025-05-22T21:30:27.388ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5d380544-d4e3-4065-a4b0-823f5cbd0dd0 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144972025-05-22T21:30:27.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5d380544-d4e3-4065-a4b0-823f5cbd0dd0 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144982025-05-22T21:30:27.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2713 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5d380544-d4e3-4065-a4b0-823f5cbd0dd0 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
144992025-05-22T21:30:28.162ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 910 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = ac4c195d-ccc8-4b57-923b-517965a07efc response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
145002025-05-22T21:30:28.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b00fd93e-2ac2-4386-861e-5e5de40b4c27 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145012025-05-22T21:30:28.404ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b00fd93e-2ac2-4386-861e-5e5de40b4c27 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145022025-05-22T21:30:28.406ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2142 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = b00fd93e-2ac2-4386-861e-5e5de40b4c27 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145032025-05-22T21:30:29.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72361513-455a-4b61-ac47-d236e890214e roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145042025-05-22T21:30:29.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72361513-455a-4b61-ac47-d236e890214e resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145052025-05-22T21:30:29.421ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72361513-455a-4b61-ac47-d236e890214e response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145062025-05-22T21:30:30.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2608602-ae5d-45b6-96e2-3056cbf8f5eb roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145072025-05-22T21:30:30.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2608602-ae5d-45b6-96e2-3056cbf8f5eb resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145082025-05-22T21:30:30.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e2608602-ae5d-45b6-96e2-3056cbf8f5eb response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145092025-05-22T21:30:31.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6b0b0e59-6752-473e-9cc5-4cebdfea9dea roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145102025-05-22T21:30:31.451ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6b0b0e59-6752-473e-9cc5-4cebdfea9dea resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145112025-05-22T21:30:31.453ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2352 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 6b0b0e59-6752-473e-9cc5-4cebdfea9dea response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145122025-05-22T21:30:32.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92927a26-4be6-42bd-a985-d97cc3e74e5d roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145132025-05-22T21:30:32.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92927a26-4be6-42bd-a985-d97cc3e74e5d resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145142025-05-22T21:30:32.468ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2595 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 92927a26-4be6-42bd-a985-d97cc3e74e5d response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145152025-05-22T21:30:33.482ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc401fd5-98b1-4ef8-9590-6077aee66d4a roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145162025-05-22T21:30:33.482ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc401fd5-98b1-4ef8-9590-6077aee66d4a resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145172025-05-22T21:30:33.484ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2788 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc401fd5-98b1-4ef8-9590-6077aee66d4a response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145182025-05-22T21:30:34.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adee16ee-b93c-4b43-bf3d-515d7810d283 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145192025-05-22T21:30:34.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adee16ee-b93c-4b43-bf3d-515d7810d283 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145202025-05-22T21:30:34.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1927 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = adee16ee-b93c-4b43-bf3d-515d7810d283 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
145212025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
145222025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
145232025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
145242025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
145252025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 27 reason = Timeout
145262025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
145272025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
145282025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
145292025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
145302025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
145312025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
145322025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
145332025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
145342025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
145352025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
145362025-05-22T21:30:35.086ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:53
145372025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
145382025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
145392025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
145402025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
145412025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145422025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
145432025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
145442025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145452025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
145462025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
145472025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
145482025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
145492025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
145502025-05-22T21:30:35.086ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
145512025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
145522025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
145532025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
145542025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
145552025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
145562025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
145572025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
145582025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145592025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
145602025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
145612025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145622025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
145632025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
145642025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 27 reason = Timeout
145652025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
145662025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
145672025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
145682025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
145692025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
145702025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
145712025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145722025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
145732025-05-22T21:30:35.087ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
145742025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
145752025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
145762025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
145772025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
145782025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
145792025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
145802025-05-22T21:30:35.087ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-05-22 21:20:35.087148263 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
145812025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
145822025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = webhook_dispatcher iteration = 14 reason = Timeout
145832025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
145842025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
145852025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
145862025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
145872025-05-22T21:30:35.087ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:85 reason = blueprint disabled target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081
145882025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
145892025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
145902025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
145912025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.521\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081"}
145922025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
145932025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
145942025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
145952025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
145962025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
145972025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145982025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
145992025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
146002025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
146012025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
146022025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146032025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
146042025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
146052025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146062025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
146072025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
146082025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146092025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
146102025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
146112025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
146122025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146132025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146142025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
146152025-05-22T21:30:35.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
146162025-05-22T21:30:35.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f1e76fec-ec67-4aad-8dad-0c46c9ec3a28.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("f66420ec-966b-48f7-b801-7a5c00f44cf4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 228962617 } })
146172025-05-22T21:30:35.087ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("998e7727-b316-426b-acab-27a7a6a12bea.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c19cbfa7-1d93-4f5e-8c3d-cd6b82ca8b37.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("d3cfc430-36be-4250-8017-a63fa9e8d8e0.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:1::1))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 228965526 } })
146182025-05-22T21:30:35.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
146192025-05-22T21:30:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.165517ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
146202025-05-22T21:30:35.088ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } dns_group = internal
146212025-05-22T21:30:35.088ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.30222ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:1::1]:5353"]}
146222025-05-22T21:30:35.089ZDEBGnexus (BackgroundTasks): activating background_task = webhook_deliverator iteration = 14 reason = Timeout
146232025-05-22T21:30:35.089ZDEBGnexus (BackgroundTasks): roles background_task = webhook_deliverator roles = RoleSet { roles: {} }
146242025-05-22T21:30:35.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_deliverator resource = Database result = Ok(())
146252025-05-22T21:30:35.092ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 233112108 } })
146262025-05-22T21:30:35.092ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.36731ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
146272025-05-22T21:30:35.092ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1178
146282025-05-22T21:30:35.092ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
146292025-05-22T21:30:35.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
146302025-05-22T21:30:35.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146312025-05-22T21:30:35.094ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146322025-05-22T21:30:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
146332025-05-22T21:30:35.097ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
146342025-05-22T21:30:35.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
146352025-05-22T21:30:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146362025-05-22T21:30:35.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146372025-05-22T21:30:35.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146382025-05-22T21:30:35.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
146392025-05-22T21:30:35.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
146402025-05-22T21:30:35.101ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146412025-05-22T21:30:35.102ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146422025-05-22T21:30:35.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146432025-05-22T21:30:35.104ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 245497223 } })
146442025-05-22T21:30:35.104ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1178
146452025-05-22T21:30:35.105ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
146462025-05-22T21:30:35.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146472025-05-22T21:30:35.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
146482025-05-22T21:30:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
146492025-05-22T21:30:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
146502025-05-22T21:30:35.106ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
146512025-05-22T21:30:35.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
146522025-05-22T21:30:35.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
146532025-05-22T21:30:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
146542025-05-22T21:30:35.107ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
146552025-05-22T21:30:35.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
146562025-05-22T21:30:35.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146572025-05-22T21:30:35.107ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
146582025-05-22T21:30:35.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
146592025-05-22T21:30:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
146602025-05-22T21:30:35.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
146612025-05-22T21:30:35.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
146622025-05-22T21:30:35.118ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 31.647511ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
146632025-05-22T21:30:35.119ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-05-22 21:20:35.087148263 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
146642025-05-22T21:30:35.119ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 32.596665ms iteration = 14 status = {"expiration":"2025-05-22T21:20:35.087148263Z","pruned":[]}
146652025-05-22T21:30:35.121ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
146662025-05-22T21:30:35.121ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
146672025-05-22T21:30:35.121ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 33.951175ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
146682025-05-22T21:30:35.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146692025-05-22T21:30:35.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
146702025-05-22T21:30:35.132ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
146712025-05-22T21:30:35.133ZINFOnexus (BackgroundTasks): all webhook delivery tasks completed background_task = webhook_deliverator file = nexus/src/app/background/tasks/webhook_deliverator.rs:205 num_receivers = 0
146722025-05-22T21:30:35.133ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_deliverator elapsed = 43.586959ms iteration = 14 status = {"by_rx":{},"error":null}
146732025-05-22T21:30:35.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146742025-05-22T21:30:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
146752025-05-22T21:30:35.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146762025-05-22T21:30:35.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 48.212238ms iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
146772025-05-22T21:30:35.139ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
146782025-05-22T21:30:35.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
146792025-05-22T21:30:35.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146802025-05-22T21:30:35.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
146812025-05-22T21:30:35.164ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146822025-05-22T21:30:35.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
146832025-05-22T21:30:35.168ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146842025-05-22T21:30:35.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
146852025-05-22T21:30:35.170ZDEBGnexus (BackgroundTasks): roles background_task = webhook_dispatcher roles = RoleSet { roles: {} }
146862025-05-22T21:30:35.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = webhook_dispatcher resource = Database result = Ok(())
146872025-05-22T21:30:35.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 84.120332ms iteration = 27 status = {"errors":[],"finish_invoked_ok":[]}
146882025-05-22T21:30:35.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146892025-05-22T21:30:35.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
146902025-05-22T21:30:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146912025-05-22T21:30:35.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
146922025-05-22T21:30:35.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146932025-05-22T21:30:35.175ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
146942025-05-22T21:30:35.175ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
146952025-05-22T21:30:35.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146962025-05-22T21:30:35.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146972025-05-22T21:30:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
146982025-05-22T21:30:35.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
146992025-05-22T21:30:35.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
147002025-05-22T21:30:35.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147012025-05-22T21:30:35.180ZDEBGnexus (BackgroundTasks): activation complete background_task = webhook_dispatcher elapsed = 93.103846ms iteration = 14 status = {"dispatched":[],"errors":[],"glob_version":"142.0.0","globs_reprocessed":{},"no_receivers":[]}
147022025-05-22T21:30:35.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147032025-05-22T21:30:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
147042025-05-22T21:30:35.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147052025-05-22T21:30:35.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147062025-05-22T21:30:35.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147072025-05-22T21:30:35.185ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147082025-05-22T21:30:35.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147092025-05-22T21:30:35.186ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
147102025-05-22T21:30:35.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147112025-05-22T21:30:35.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147122025-05-22T21:30:35.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147132025-05-22T21:30:35.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147142025-05-22T21:30:35.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147152025-05-22T21:30:35.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
147162025-05-22T21:30:35.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147172025-05-22T21:30:35.191ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.176565ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
147182025-05-22T21:30:35.192ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147192025-05-22T21:30:35.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147202025-05-22T21:30:35.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147212025-05-22T21:30:35.195ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
147222025-05-22T21:30:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
147232025-05-22T21:30:35.195ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
147242025-05-22T21:30:35.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
147252025-05-22T21:30:35.199ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-cfb86abd-85e5-4869-9e83-7fe6eb951ca2.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1744, tv_nsec: 340498166 } })
147262025-05-22T21:30:35.200ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1178 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
147272025-05-22T21:30:35.204ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
147282025-05-22T21:30:35.204ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:137 found = 0 not_ready_to_be_deleted = 0
147292025-05-22T21:30:35.204ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 117.925505ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
147302025-05-22T21:30:35.206ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147312025-05-22T21:30:35.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147322025-05-22T21:30:35.211ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 124.071416ms iteration = 27 status = {"errors":[],"requests_created_ok":[]}
147332025-05-22T21:30:35.212ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 125.748521ms iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
147342025-05-22T21:30:35.213ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:547 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
147352025-05-22T21:30:35.213ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 126.39734ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
147362025-05-22T21:30:35.217ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
147372025-05-22T21:30:35.217ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147382025-05-22T21:30:35.218ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "386a0357-4dd0-492d-9a62-88455211d920", "content-length": "26", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
147392025-05-22T21:30:35.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147402025-05-22T21:30:35.219ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147412025-05-22T21:30:35.219ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
147422025-05-22T21:30:35.219ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
147432025-05-22T21:30:35.219ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
147442025-05-22T21:30:35.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
147452025-05-22T21:30:35.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
147462025-05-22T21:30:35.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147472025-05-22T21:30:35.221ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1186 zone_address = fd00:1122:3344:101::2
147482025-05-22T21:30:35.221ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147492025-05-22T21:30:35.222ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0078bbf-467a-4aca-9226-d1bab33aeab5", "content-length": "26", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
147502025-05-22T21:30:35.222ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1189 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147512025-05-22T21:30:35.223ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
147522025-05-22T21:30:35.223ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147532025-05-22T21:30:35.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
147542025-05-22T21:30:35.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147552025-05-22T21:30:35.224ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147562025-05-22T21:30:35.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147572025-05-22T21:30:35.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147582025-05-22T21:30:35.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 148.227455ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
147592025-05-22T21:30:35.242ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 155.873469ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
147602025-05-22T21:30:35.244ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147612025-05-22T21:30:35.247ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
147622025-05-22T21:30:35.247ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
147632025-05-22T21:30:35.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
147642025-05-22T21:30:35.248ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
147652025-05-22T21:30:35.248ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
147662025-05-22T21:30:35.248ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
147672025-05-22T21:30:35.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
147682025-05-22T21:30:35.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
147692025-05-22T21:30:35.250ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
147702025-05-22T21:30:35.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
147712025-05-22T21:30:35.255ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147722025-05-22T21:30:35.255ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
147732025-05-22T21:30:35.255ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147742025-05-22T21:30:35.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147752025-05-22T21:30:35.285ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
147762025-05-22T21:30:35.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
147772025-05-22T21:30:35.309ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 222.872886ms iteration = 30 status = {"physical_disks_added":0}
147782025-05-22T21:30:35.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
147792025-05-22T21:30:35.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
147802025-05-22T21:30:35.380ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1186 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 zone_address = fd00:1122:3344:101::2
147812025-05-22T21:30:35.380ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147822025-05-22T21:30:35.380ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03d887b7-4f5c-43e0-a98c-9a4ee89b1ea3", "content-length": "26", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
147832025-05-22T21:30:35.380ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1189 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147842025-05-22T21:30:35.381ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
147852025-05-22T21:30:35.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "e2b9b824-7fb2-4551-95e3-d04aa464e279", "date": "Thu, 22 May 2025 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147862025-05-22T21:30:35.381ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147872025-05-22T21:30:35.383ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1223 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
147882025-05-22T21:30:35.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8d75cef3-06cc-4942-88f5-44781b90b953", "date": "Thu, 22 May 2025 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147892025-05-22T21:30:35.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147902025-05-22T21:30:35.385ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
147912025-05-22T21:30:35.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 298.421331ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
147922025-05-22T21:30:35.393ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
147932025-05-22T21:30:35.444ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
147942025-05-22T21:30:35.444ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
147952025-05-22T21:30:35.444ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "38f31c3b-85e4-4f2a-abfe-319ef3f6da04", "content-length": "372", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
147962025-05-22T21:30:35.444ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147972025-05-22T21:30:35.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147982025-05-22T21:30:35.448ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147992025-05-22T21:30:35.448ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148002025-05-22T21:30:35.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148012025-05-22T21:30:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
148022025-05-22T21:30:35.451ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148032025-05-22T21:30:35.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148042025-05-22T21:30:35.453ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 366.656245ms iteration = 27 status = null
148052025-05-22T21:30:35.457ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
148062025-05-22T21:30:35.457ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 370.678746ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
148072025-05-22T21:30:35.461ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.551374ms iteration = 27 status = {}
148082025-05-22T21:30:35.480ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148092025-05-22T21:30:35.483ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
148102025-05-22T21:30:35.483ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
148112025-05-22T21:30:35.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148122025-05-22T21:30:35.484ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
148132025-05-22T21:30:35.484ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
148142025-05-22T21:30:35.484ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 397.954821ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
148152025-05-22T21:30:35.485ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
148162025-05-22T21:30:35.485ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
148172025-05-22T21:30:35.485ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148182025-05-22T21:30:35.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148192025-05-22T21:30:35.485ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148202025-05-22T21:30:35.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148212025-05-22T21:30:35.486ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
148222025-05-22T21:30:35.486ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148232025-05-22T21:30:35.486ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148242025-05-22T21:30:35.486ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148252025-05-22T21:30:35.487ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83013ea8-f797-4359-81d5-f7ded9aaf8c3", "date": "Thu, 22 May 2025 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148262025-05-22T21:30:35.487ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148272025-05-22T21:30:35.487ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:363
148282025-05-22T21:30:35.487ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 400.929846ms iteration = 27 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
148292025-05-22T21:30:35.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "91790925-8509-473e-a621-55c4f85b727a", "date": "Thu, 22 May 2025 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148302025-05-22T21:30:35.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148312025-05-22T21:30:35.489ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
148322025-05-22T21:30:35.489ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
148332025-05-22T21:30:35.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
148342025-05-22T21:30:35.490ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "f9f5bf19-0e49-4392-9274-a38fe787e2a8", "date": "Thu, 22 May 2025 21:30:35 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148352025-05-22T21:30:35.490ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148362025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: cfb86abd-85e5-4869-9e83-7fe6eb951ca2, lookup_type: ById(cfb86abd-85e5-4869-9e83-7fe6eb951ca2) } result = Ok(())
148372025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
148382025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
148392025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
148402025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
148412025-05-22T21:30:35.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
148422025-05-22T21:30:35.492ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:1::1]:5353] }
148432025-05-22T21:30:35.492ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 405.325911ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
148442025-05-22T21:30:35.493ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 406.113063ms iteration = 27 status = 0
148452025-05-22T21:30:35.497ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = b3443bb6-b848-481c-a60a-ab12f3f2e839 dns_zone_name = control-plane.oxide.internal found_so_far = 55 version = 1
148462025-05-22T21:30:35.497ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
148472025-05-22T21:30:35.497ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-05-22 21:17:48.196631 UTC dns_group = internal generation = 1
148482025-05-22T21:30:35.498ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 411.188799ms iteration = 14 status = {"generation":1}
148492025-05-22T21:30:35.511ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
148502025-05-22T21:30:35.511ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
148512025-05-22T21:30:35.511ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a349e89e-94e5-4dd8-91f0-be4da9a956f6", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
148522025-05-22T21:30:35.511ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148532025-05-22T21:30:35.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148542025-05-22T21:30:35.515ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148552025-05-22T21:30:35.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148562025-05-22T21:30:35.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148572025-05-22T21:30:35.520ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148582025-05-22T21:30:35.523ZINFOnexus (BackgroundTasks): VPC route manager sled cfb86abd-85e5-4869-9e83-7fe6eb951ca2 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
148592025-05-22T21:30:35.523ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148602025-05-22T21:30:35.526ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
148612025-05-22T21:30:35.526ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 0 version = 2
148622025-05-22T21:30:35.526ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
148632025-05-22T21:30:35.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148642025-05-22T21:30:35.529ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148652025-05-22T21:30:35.529ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148662025-05-22T21:30:35.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
148672025-05-22T21:30:35.531ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148682025-05-22T21:30:35.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148692025-05-22T21:30:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
148702025-05-22T21:30:35.532ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
148712025-05-22T21:30:35.532ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
148722025-05-22T21:30:35.533ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148732025-05-22T21:30:35.534ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = a486978d-3449-4eaf-9ab6-30bf400ccd91 dns_zone_name = oxide.test found_so_far = 1 version = 2
148742025-05-22T21:30:35.534ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
148752025-05-22T21:30:35.534ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-05-22 21:17:48.982070 UTC dns_group = external generation = 2
148762025-05-22T21:30:35.534ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 447.646431ms iteration = 14 status = {"generation":2}
148772025-05-22T21:30:35.535ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
148782025-05-22T21:30:35.535ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148792025-05-22T21:30:35.535ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148802025-05-22T21:30:35.544ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-05-22T21:17:32.336382Z, time_modified: 2025-05-22T21:17:32.336382Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, db_silo: Silo { identity: SiloIdentity { id: de8df5b2-66ea-4dc0-9fef-ace14414c8a4, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-05-22T21:17:48.925727Z, time_modified: 2025-05-22T21:17:48.925727Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2" }] }) }
148812025-05-22T21:30:35.544ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 457.585189ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]}},"default_endpoint":{"silo_id":"de8df5b2-66ea-4dc0-9fef-ace14414c8a4","tls_certs":["0a19af6325469eb1c6f7d83463c76803f1dc22e2ae37a9507b757a7931633aa2"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
148822025-05-22T21:30:35.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148832025-05-22T21:30:35.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148842025-05-22T21:30:35.561ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 6f56ffe5-c558-409d-91c7-cc9b729a069c, rack_id: 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(c92af178-a42a-4b81-87b1-796e222cfd9e) } rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
148852025-05-22T21:30:35.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148862025-05-22T21:30:35.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148872025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1833 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
148882025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1860 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = c92af178-a42a-4b81-87b1-796e222cfd9e
148892025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
148902025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
148912025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148922025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148932025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148942025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2007 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148952025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148962025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:2043 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148972025-05-22T21:30:35.593ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744
148982025-05-22T21:30:35.593ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148992025-05-22T21:30:35.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149002025-05-22T21:30:35.597ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch_location = Switch0
149012025-05-22T21:30:35.597ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
149022025-05-22T21:30:35.622ZINFOnexus (BackgroundTasks): instance reincarnation completed successfully background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:113 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0
149032025-05-22T21:30:35.622ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 535.647001ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
149042025-05-22T21:30:35.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0d998e9-e52d-4d25-931c-10bad37e13ae roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149052025-05-22T21:30:35.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0d998e9-e52d-4d25-931c-10bad37e13ae resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149062025-05-22T21:30:35.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 3223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c0d998e9-e52d-4d25-931c-10bad37e13ae response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149072025-05-22T21:30:35.677ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "98e76187-20d6-4ad3-adc0-83f730721054", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
149082025-05-22T21:30:35.679ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 592.436696ms iteration = 28 status = {}
149092025-05-22T21:30:35.683ZDEBGnexus (BackgroundTasks): client request SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
149102025-05-22T21:30:35.685ZDEBGnexus (BackgroundTasks): client response SledAgent = cfb86abd-85e5-4869-9e83-7fe6eb951ca2 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "97640dbd-611e-4e5e-bf51-e3588469d995", "content-length": "691", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
149112025-05-22T21:30:35.685ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
149122025-05-22T21:30:35.685ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
149132025-05-22T21:30:35.685ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
149142025-05-22T21:30:35.685ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 598.126781ms iteration = 28 status = {}
149152025-05-22T21:30:35.789ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb998255-cdb5-4558-9c0d-ebed8f547246", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
149162025-05-22T21:30:35.789ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 switch = Switch0
149172025-05-22T21:30:35.789ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
149182025-05-22T21:30:35.790ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 6591ad4d-a760-4e77-a3f6-8f4ecdb7c744 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "573d0401-248e-462d-b3b1-e01e7ed275c3", "content-length": "682", "date": "Thu, 22 May 2025 21:30:35 GMT"} })
149192025-05-22T21:30:35.790ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149202025-05-22T21:30:35.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149212025-05-22T21:30:35.794ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149222025-05-22T21:30:35.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149232025-05-22T21:30:35.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149242025-05-22T21:30:35.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149252025-05-22T21:30:35.799ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
149262025-05-22T21:30:35.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
149272025-05-22T21:30:35.807ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 720.494422ms iteration = 27 status = {}
149282025-05-22T21:30:36.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb50a1c2-571e-4209-9bc0-7e046ec48008 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149292025-05-22T21:30:36.701ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb50a1c2-571e-4209-9bc0-7e046ec48008 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149302025-05-22T21:30:36.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fb50a1c2-571e-4209-9bc0-7e046ec48008 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149312025-05-22T21:30:37.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc87c791-1ed2-4840-93a3-f9baac5995f3 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149322025-05-22T21:30:37.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc87c791-1ed2-4840-93a3-f9baac5995f3 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149332025-05-22T21:30:37.717ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2431 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = fc87c791-1ed2-4840-93a3-f9baac5995f3 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149342025-05-22T21:30:38.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 570 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 4dd208bb-0e7c-4088-ae3b-1a8e753536a0 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
149352025-05-22T21:30:38.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b7c847f-427f-48d0-97db-ca9413b90a01 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149362025-05-22T21:30:38.730ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b7c847f-427f-48d0-97db-ca9413b90a01 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149372025-05-22T21:30:38.732ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5b7c847f-427f-48d0-97db-ca9413b90a01 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149382025-05-22T21:30:39.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5f0abc8-73be-4894-a3e2-8997c4366c40 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149392025-05-22T21:30:39.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5f0abc8-73be-4894-a3e2-8997c4366c40 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149402025-05-22T21:30:39.749ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2774 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = d5f0abc8-73be-4894-a3e2-8997c4366c40 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149412025-05-22T21:30:40.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9391946-50cb-4c56-b134-deb1dcd38613 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149422025-05-22T21:30:40.763ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9391946-50cb-4c56-b134-deb1dcd38613 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149432025-05-22T21:30:40.765ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2594 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e9391946-50cb-4c56-b134-deb1dcd38613 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149442025-05-22T21:30:41.778ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bc7a850-3e82-49f8-a81d-a7ce74e963fa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149452025-05-22T21:30:41.778ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bc7a850-3e82-49f8-a81d-a7ce74e963fa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149462025-05-22T21:30:41.780ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2288 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 3bc7a850-3e82-49f8-a81d-a7ce74e963fa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149472025-05-22T21:30:42.794ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72896ef2-efc4-41f7-950c-fb8d98e2690b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149482025-05-22T21:30:42.794ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72896ef2-efc4-41f7-950c-fb8d98e2690b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149492025-05-22T21:30:42.796ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2119 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 72896ef2-efc4-41f7-950c-fb8d98e2690b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149502025-05-22T21:30:43.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88543dd-d434-4146-b2ce-3d0da152121f roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149512025-05-22T21:30:43.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88543dd-d434-4146-b2ce-3d0da152121f resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149522025-05-22T21:30:43.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = e88543dd-d434-4146-b2ce-3d0da152121f response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149532025-05-22T21:30:44.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5f521055-0423-4b7e-b6fb-53ad55d04426 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149542025-05-22T21:30:44.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5f521055-0423-4b7e-b6fb-53ad55d04426 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149552025-05-22T21:30:44.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2141 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 5f521055-0423-4b7e-b6fb-53ad55d04426 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149562025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
149572025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
149582025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149592025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149602025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149612025-05-22T21:30:45.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149622025-05-22T21:30:45.089ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
149632025-05-22T21:30:45.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
149642025-05-22T21:30:45.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149652025-05-22T21:30:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
149662025-05-22T21:30:45.092ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149672025-05-22T21:30:45.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149682025-05-22T21:30:45.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149692025-05-22T21:30:45.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149702025-05-22T21:30:45.096ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
149712025-05-22T21:30:45.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: c78ad881-52ba-4b09-b51e-8b2df9dbe081, lookup_type: ById(c78ad881-52ba-4b09-b51e-8b2df9dbe081) } result = Ok(())
149722025-05-22T21:30:45.099ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
149732025-05-22T21:30:45.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
149742025-05-22T21:30:45.110ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 original_time_created = 2025-05-22 21:17:28.505296 UTC target_id = c78ad881-52ba-4b09-b51e-8b2df9dbe081 time_created = 2025-05-22 21:17:28.505296 UTC
149752025-05-22T21:30:45.110ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.319677ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"c78ad881-52ba-4b09-b51e-8b2df9dbe081","time_created":"2025-05-22T21:17:28.505296Z"}
149762025-05-22T21:30:45.120ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.483318ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
149772025-05-22T21:30:45.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6e5cc47-8f11-4e06-9dea-0fb25f51c8d9 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149782025-05-22T21:30:45.839ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6e5cc47-8f11-4e06-9dea-0fb25f51c8d9 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149792025-05-22T21:30:45.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2333 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = c6e5cc47-8f11-4e06-9dea-0fb25f51c8d9 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149802025-05-22T21:30:46.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f40b49e-25d2-4615-8eb6-24034445dc65 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149812025-05-22T21:30:46.855ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f40b49e-25d2-4615-8eb6-24034445dc65 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149822025-05-22T21:30:46.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 8f40b49e-25d2-4615-8eb6-24034445dc65 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149832025-05-22T21:30:47.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caafa1a9-40b6-42a2-a3ec-03bbf88a3e73 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149842025-05-22T21:30:47.873ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caafa1a9-40b6-42a2-a3ec-03bbf88a3e73 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149852025-05-22T21:30:47.875ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2514 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = caafa1a9-40b6-42a2-a3ec-03bbf88a3e73 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149862025-05-22T21:30:48.161ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 532 local_addr = [fd00:1122:3344:101::b]:55772 method = GET remote_addr = [fd00:1122:3344:101::d]:53420 req_id = 451457bd-0c2f-471d-87fe-9c85b5d8d375 response_code = 200 uri = /548ef0f1-b45a-42d9-a620-b374dd0fb713
149872025-05-22T21:30:48.888ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdc96604-56fb-49a7-80ce-adc203e723aa roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149882025-05-22T21:30:48.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdc96604-56fb-49a7-80ce-adc203e723aa resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149892025-05-22T21:30:48.891ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2313 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = cdc96604-56fb-49a7-80ce-adc203e723aa response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149902025-05-22T21:30:49.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 99a3ae6e-93a6-4077-b659-4503ca161300 roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149912025-05-22T21:30:49.904ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 99a3ae6e-93a6-4077-b659-4503ca161300 resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149922025-05-22T21:30:49.906ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = 99a3ae6e-93a6-4077-b659-4503ca161300 response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149932025-05-22T21:30:50.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a082a5a4-d04a-41ce-9672-fb089aedd99b roles = RoleSet { roles: {} } uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149942025-05-22T21:30:50.920ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a082a5a4-d04a-41ce-9672-fb089aedd99b resource = Database result = Ok(()) uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2
149952025-05-22T21:30:50.922ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.2/src/server.rs:867 latency_us = 2207 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:49075 req_id = a082a5a4-d04a-41ce-9672-fb089aedd99b response_code = 200 uri = /probes/cfb86abd-85e5-4869-9e83-7fe6eb951ca2