Max level shown:
1 [ Mar 25 01:19:18 Enabled. ]
2 [ Mar 25 01:19:18 Rereading configuration. ]
3 [ Mar 25 01:19:20 Rereading configuration. ]
4 [ Mar 25 01:19:28 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Mar 25 01:19:28 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72025-03-25T01:19:29.303ZDEBGnexus: registered DTrace probes
82025-03-25T01:19:29.306ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:78
92025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232025-03-25T01:19:29.318ZINFOnexus (ServerContext): registering Oso class class = TargetReleaseConfig file = nexus/auth/src/authz/oso_generic.rs:68
242025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
252025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
262025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
272025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
282025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = AffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
292025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = AntiAffinityGroup file = nexus/auth/src/authz/oso_generic.rs:68
302025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
312025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
322025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
332025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
342025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
352025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
362025-03-25T01:19:29.319ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
372025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
382025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
392025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
402025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
412025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
422025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
432025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
442025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
452025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
462025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
472025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
482025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
492025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
502025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
512025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
522025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
532025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
542025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
552025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
562025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
572025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SupportBundle file = nexus/auth/src/authz/oso_generic.rs:68
582025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
592025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
602025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
612025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
622025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
632025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
642025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
652025-03-25T01:19:29.320ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
662025-03-25T01:19:29.320ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource TargetReleaseConfig {\n\tpermissions = [\n\t "read", # read the current target release\n\t "modify", # change the current target release\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", resource: TargetReleaseConfig)\n\tif resource.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource AffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AffinityGroup)\n if child.project = parent;\n \n\n resource AntiAffinityGroup {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: AntiAffinityGroup)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n resource SupportBundle {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: SupportBundle)\n if child.fleet = fleet;\n \n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
672025-03-25T01:19:29.339ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:222
682025-03-25T01:19:29.341ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
692025-03-25T01:19:29.344ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:278
702025-03-25T01:19:29.348ZDEBGnexus (ServerContext): registered USDT probes
712025-03-25T01:19:29.521ZINFOnexus: Database schema version is up to date desired_version = 131.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:144 found_version = 131.0.0
722025-03-25T01:19:29.525ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/steno-0.4.1/src/sec.rs:813 sec_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
732025-03-25T01:19:29.587ZDEBGnexus (clickhouse-client): registered USDT probes id = 8d6013bf-34c7-460d-b291-c52045a03cc1
742025-03-25T01:19:29.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
752025-03-25T01:19:29.619ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
762025-03-25T01:19:29.622ZDEBGnexus (DataLoader): attempting to create built-in users
772025-03-25T01:19:29.622ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
782025-03-25T01:19:29.622ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
792025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks versions = all
802025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /bgtasks/activate versions = all
812025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
822025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /clickhouse/policy versions = all
832025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /clickhouse/policy versions = all
842025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
852025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
862025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
872025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
882025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
892025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga versions = all
902025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
912025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all versions = all
922025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
932025-03-25T01:19:29.637ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
942025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/import versions = all
952025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
962025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /deployment/blueprints/target versions = all
972025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /deployment/blueprints/target versions = all
982025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
992025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1002025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /disks/{disk_id} versions = all
1012025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1022025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/collectors versions = all
1032025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1042025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /metrics/producers versions = all
1052025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1062025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /physical-disk/expunge versions = all
1072025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /probes/{sled} versions = all
1082025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1092025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas versions = all
1102025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sagas/{saga_id} versions = all
1112025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1122025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1132025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1142025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/add versions = all
1152025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /sleds/expunge versions = all
1162025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = GET path = /sleds/uninitialized versions = all
1172025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /switch/{switch_id} versions = all
1182025-03-25T01:19:29.638ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1192025-03-25T01:19:29.639ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::b]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1202025-03-25T01:19:29.639ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:12221
1212025-03-25T01:19:29.639ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12221
1222025-03-25T01:19:29.639ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1232025-03-25T01:19:29.639ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1242025-03-25T01:19:29.643ZWARNnexus: Cannot look up rack: Object (of type ById(16a011db-af85-49cc-8fa6-b468f46a78bd)) not found: rack file = nexus/src/app/rack.rs:776
1252025-03-25T01:19:29.694ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1262025-03-25T01:19:29.694ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1272025-03-25T01:19:29.696ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1282025-03-25T01:19:29.696ZDEBGnexus (DataLoader): attempting to create built-in roles
1292025-03-25T01:19:29.696ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1302025-03-25T01:19:29.696ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1312025-03-25T01:19:29.703ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:84
1322025-03-25T01:19:29.703ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1332025-03-25T01:19:29.705ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1342025-03-25T01:19:29.705ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1352025-03-25T01:19:29.705ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1362025-03-25T01:19:29.705ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1372025-03-25T01:19:30.110ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:113
1382025-03-25T01:19:30.110ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1392025-03-25T01:19:30.111ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1402025-03-25T01:19:30.111ZDEBGnexus (DataLoader): attempting to create built-in silos
1412025-03-25T01:19:30.111ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1422025-03-25T01:19:30.111ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1432025-03-25T01:19:30.514ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:93
1442025-03-25T01:19:30.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1452025-03-25T01:19:30.514ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1462025-03-25T01:19:30.519ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472025-03-25T01:19:30.519ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482025-03-25T01:19:30.520ZDEBGnexus (DataLoader): attempting to create built-in projects
1492025-03-25T01:19:30.520ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502025-03-25T01:19:30.520ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512025-03-25T01:19:30.533ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1522025-03-25T01:19:30.533ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1532025-03-25T01:19:30.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542025-03-25T01:19:30.565ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552025-03-25T01:19:30.613ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562025-03-25T01:19:30.615ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1572025-03-25T01:19:30.615ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1582025-03-25T01:19:30.615ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1592025-03-25T01:19:30.622ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1602025-03-25T01:19:30.622ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1612025-03-25T01:19:30.670ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622025-03-25T01:19:30.671ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1632025-03-25T01:19:30.671ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642025-03-25T01:19:30.671ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652025-03-25T01:19:30.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:49786
1662025-03-25T01:19:30.755ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1672025-03-25T01:19:30.755ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682025-03-25T01:19:30.756ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1692025-03-25T01:19:30.756ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1702025-03-25T01:19:30.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1712025-03-25T01:19:30.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1722025-03-25T01:19:30.766ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49786 req_id = 16807950-defb-4347-91dd-9d691cae58e4 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
1732025-03-25T01:19:30.766ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49786 req_id = 16807950-defb-4347-91dd-9d691cae58e4 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
1742025-03-25T01:19:30.769ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1752025-03-25T01:19:30.770ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1762025-03-25T01:19:30.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 17364 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:49786 req_id = 16807950-defb-4347-91dd-9d691cae58e4 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
1772025-03-25T01:19:30.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1782025-03-25T01:19:30.799ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1792025-03-25T01:19:30.800ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802025-03-25T01:19:30.800ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1812025-03-25T01:19:30.802ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822025-03-25T01:19:30.802ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832025-03-25T01:19:30.846ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842025-03-25T01:19:30.848ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1852025-03-25T01:19:30.848ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862025-03-25T01:19:30.849ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872025-03-25T01:19:30.850ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882025-03-25T01:19:30.850ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892025-03-25T01:19:30.857ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902025-03-25T01:19:30.857ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912025-03-25T01:19:30.859ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922025-03-25T01:19:30.861ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932025-03-25T01:19:30.861ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942025-03-25T01:19:30.861ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952025-03-25T01:19:30.894ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962025-03-25T01:19:30.895ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972025-03-25T01:19:30.896ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982025-03-25T01:19:30.896ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992025-03-25T01:19:30.897ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002025-03-25T01:19:30.898ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012025-03-25T01:19:30.899ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022025-03-25T01:19:30.902ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2032025-03-25T01:19:30.902ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042025-03-25T01:19:30.902ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052025-03-25T01:19:30.924ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062025-03-25T01:19:30.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072025-03-25T01:19:30.953ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082025-03-25T01:19:30.953ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092025-03-25T01:19:30.956ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102025-03-25T01:19:30.956ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112025-03-25T01:19:30.957ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122025-03-25T01:19:30.958ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132025-03-25T01:19:30.961ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142025-03-25T01:19:30.961ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152025-03-25T01:19:30.964ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162025-03-25T01:19:30.966ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2172025-03-25T01:19:30.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182025-03-25T01:19:30.967ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192025-03-25T01:19:31.005ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202025-03-25T01:19:31.005ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212025-03-25T01:19:31.006ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222025-03-25T01:19:31.007ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232025-03-25T01:19:31.008ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242025-03-25T01:19:31.008ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252025-03-25T01:19:31.009ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262025-03-25T01:19:31.012ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2272025-03-25T01:19:31.012ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282025-03-25T01:19:31.013ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292025-03-25T01:19:31.087ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302025-03-25T01:19:31.087ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312025-03-25T01:19:31.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322025-03-25T01:19:31.089ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332025-03-25T01:19:31.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342025-03-25T01:19:31.091ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352025-03-25T01:19:31.092ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362025-03-25T01:19:31.095ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2372025-03-25T01:19:31.095ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382025-03-25T01:19:31.095ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392025-03-25T01:19:31.145ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2402025-03-25T01:19:31.145ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2412025-03-25T01:19:31.146ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2422025-03-25T01:19:31.149ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2432025-03-25T01:19:31.149ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2442025-03-25T01:19:31.174ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2452025-03-25T01:19:31.175ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2462025-03-25T01:19:31.177ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2472025-03-25T01:19:31.177ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2482025-03-25T01:19:31.178ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2492025-03-25T01:19:31.178ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2502025-03-25T01:19:31.180ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512025-03-25T01:19:31.180ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522025-03-25T01:19:31.181ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532025-03-25T01:19:31.184ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2542025-03-25T01:19:31.184ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552025-03-25T01:19:31.184ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562025-03-25T01:19:31.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572025-03-25T01:19:31.186ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582025-03-25T01:19:31.187ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592025-03-25T01:19:31.187ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602025-03-25T01:19:31.188ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612025-03-25T01:19:31.191ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2622025-03-25T01:19:31.191ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632025-03-25T01:19:31.191ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2642025-03-25T01:19:31.194ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652025-03-25T01:19:31.195ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662025-03-25T01:19:31.196ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672025-03-25T01:19:31.196ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682025-03-25T01:19:31.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692025-03-25T01:19:31.198ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702025-03-25T01:19:31.199ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712025-03-25T01:19:31.201ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2722025-03-25T01:19:31.201ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732025-03-25T01:19:31.202ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742025-03-25T01:19:31.286ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:284
2752025-03-25T01:19:31.286ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2762025-03-25T01:19:31.286ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772025-03-25T01:19:31.287ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782025-03-25T01:19:31.304ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792025-03-25T01:19:31.304ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802025-03-25T01:19:31.306ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812025-03-25T01:19:31.306ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2822025-03-25T01:19:31.308ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832025-03-25T01:19:31.308ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842025-03-25T01:19:31.309ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2852025-03-25T01:19:31.310ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2862025-03-25T01:19:31.310ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872025-03-25T01:19:31.311ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882025-03-25T01:19:31.312ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892025-03-25T01:19:31.315ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2902025-03-25T01:19:31.315ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912025-03-25T01:19:31.315ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922025-03-25T01:19:31.317ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932025-03-25T01:19:31.318ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942025-03-25T01:19:31.319ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952025-03-25T01:19:31.319ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962025-03-25T01:19:31.321ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972025-03-25T01:19:31.321ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982025-03-25T01:19:31.322ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992025-03-25T01:19:31.324ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3002025-03-25T01:19:31.337ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012025-03-25T01:19:31.338ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022025-03-25T01:19:31.339ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032025-03-25T01:19:31.339ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042025-03-25T01:19:31.341ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052025-03-25T01:19:31.341ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062025-03-25T01:19:31.342ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072025-03-25T01:19:31.345ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3082025-03-25T01:19:31.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092025-03-25T01:19:31.346ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102025-03-25T01:19:31.446ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112025-03-25T01:19:31.446ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122025-03-25T01:19:31.448ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132025-03-25T01:19:31.449ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142025-03-25T01:19:31.450ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152025-03-25T01:19:31.450ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3162025-03-25T01:19:31.452ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172025-03-25T01:19:31.452ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182025-03-25T01:19:31.453ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192025-03-25T01:19:31.456ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3202025-03-25T01:19:31.476ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212025-03-25T01:19:31.476ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222025-03-25T01:19:31.478ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232025-03-25T01:19:31.478ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242025-03-25T01:19:31.479ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252025-03-25T01:19:31.479ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262025-03-25T01:19:31.481ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272025-03-25T01:19:31.484ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3282025-03-25T01:19:31.484ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292025-03-25T01:19:31.484ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302025-03-25T01:19:31.543ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312025-03-25T01:19:31.544ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3322025-03-25T01:19:31.559ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332025-03-25T01:19:31.560ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342025-03-25T01:19:31.596ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352025-03-25T01:19:31.596ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362025-03-25T01:19:31.598ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372025-03-25T01:19:31.598ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382025-03-25T01:19:31.599ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392025-03-25T01:19:31.600ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402025-03-25T01:19:31.601ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412025-03-25T01:19:31.601ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422025-03-25T01:19:31.602ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432025-03-25T01:19:31.603ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442025-03-25T01:19:31.604ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452025-03-25T01:19:31.608ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ById(001de000-c470-4000-8000-000000000003) } result = Ok(())
3462025-03-25T01:19:31.608ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472025-03-25T01:19:31.608ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482025-03-25T01:19:31.613ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:350
3492025-03-25T01:19:31.613ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:226
3502025-03-25T01:19:31.613ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512025-03-25T01:19:31.614ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522025-03-25T01:19:31.614ZDEBGnexus (DataLoader): attempting to create silo users
3532025-03-25T01:19:31.614ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3542025-03-25T01:19:31.614ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3552025-03-25T01:19:31.625ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3562025-03-25T01:19:31.625ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3572025-03-25T01:19:31.625ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3582025-03-25T01:19:31.625ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3592025-03-25T01:19:31.644ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
3602025-03-25T01:19:31.644ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
3612025-03-25T01:19:31.645ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3622025-03-25T01:19:31.645ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632025-03-25T01:19:31.645ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642025-03-25T01:19:31.645ZWARNnexus: Cannot look up rack: Object (of type ById(16a011db-af85-49cc-8fa6-b468f46a78bd)) not found: rack file = nexus/src/app/rack.rs:776
3652025-03-25T01:19:31.658ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662025-03-25T01:19:31.658ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672025-03-25T01:19:31.679ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3682025-03-25T01:19:31.679ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3692025-03-25T01:19:31.681ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3702025-03-25T01:19:31.682ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3712025-03-25T01:19:31.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3722025-03-25T01:19:31.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3732025-03-25T01:19:31.728ZINFOnexus: populate complete file = nexus/src/app/mod.rs:437
3742025-03-25T01:19:31.728ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:446
3752025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3762025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3772025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
3782025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3792025-03-25T01:19:31.731ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
3802025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
3812025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
3822025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
3832025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
3842025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
3852025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
3862025-03-25T01:19:31.731ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3872025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3882025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
3892025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3902025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
3912025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
3922025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 1 reason = Timeout
3932025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
3942025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3952025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3962025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
3972025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
3982025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3992025-03-25T01:19:31.731ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:73 reason = no blueprint
4002025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4012025-03-25T01:19:31.731ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4022025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 1 reason = Timeout
4032025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4042025-03-25T01:19:31.731ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4052025-03-25T01:19:31.731ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
4062025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4072025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4082025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4092025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4102025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4112025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4122025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4132025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4142025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4152025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 1 reason = Timeout
4162025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4172025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4182025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4192025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4202025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 1 reason = Timeout
4212025-03-25T01:19:31.731ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4222025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4232025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4242025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4252025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4262025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4272025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4282025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4292025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
4302025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4312025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4322025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4332025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4342025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4352025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4362025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4372025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4382025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4392025-03-25T01:19:31.732ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4402025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4412025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4422025-03-25T01:19:31.732ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4432025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4442025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4452025-03-25T01:19:31.732ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:09:31.732824967 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4462025-03-25T01:19:31.732ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4472025-03-25T01:19:31.732ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4482025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4492025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.210828ms iteration = 1 status = {"error":"no config nor servers"}
4502025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.218988ms iteration = 1 status = {"error":"no blueprint"}
4512025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 1.40267ms iteration = 1 status = {"error":"no config nor servers"}
4522025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.186617ms iteration = 1 status = {"error":"no blueprint"}
4532025-03-25T01:19:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 1.191617ms iteration = 1 status = {"error":"no blueprint"}
4542025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4552025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4562025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4572025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
4582025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4592025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4602025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4612025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4622025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4632025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4642025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
4652025-03-25T01:19:31.734ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4662025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4672025-03-25T01:19:31.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4682025-03-25T01:19:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4692025-03-25T01:19:31.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4702025-03-25T01:19:31.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4712025-03-25T01:19:31.739ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 875, tv_nsec: 456625612 } })
4722025-03-25T01:19:31.739ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 875, tv_nsec: 456815184 } })
4732025-03-25T01:19:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4742025-03-25T01:19:31.739ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4752025-03-25T01:19:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 8.514042ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
4762025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4772025-03-25T01:19:31.740ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4782025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 36.241\u{b5}s iteration = 2 status = {"error":"no config"}
4792025-03-25T01:19:31.740ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4802025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 8.703924ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
4812025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4822025-03-25T01:19:31.740ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4832025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 19.53\u{b5}s iteration = 2 status = {"error":"no config"}
4842025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
4852025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4862025-03-25T01:19:31.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4872025-03-25T01:19:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4882025-03-25T01:19:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4892025-03-25T01:19:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4902025-03-25T01:19:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4912025-03-25T01:19:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
4922025-03-25T01:19:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
4932025-03-25T01:19:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4942025-03-25T01:19:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4952025-03-25T01:19:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4962025-03-25T01:19:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4972025-03-25T01:19:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4982025-03-25T01:19:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4992025-03-25T01:19:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5002025-03-25T01:19:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5012025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5022025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5032025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
5042025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5052025-03-25T01:19:31.744ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5062025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5072025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5082025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5092025-03-25T01:19:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5102025-03-25T01:19:31.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5112025-03-25T01:19:31.746ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5122025-03-25T01:19:31.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5132025-03-25T01:19:31.748ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5142025-03-25T01:19:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5152025-03-25T01:19:31.749ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5162025-03-25T01:19:31.749ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5172025-03-25T01:19:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5182025-03-25T01:19:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5192025-03-25T01:19:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5202025-03-25T01:19:31.756ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 24.825955ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5212025-03-25T01:19:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5222025-03-25T01:19:31.757ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5232025-03-25T01:19:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5242025-03-25T01:19:31.764ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5252025-03-25T01:19:31.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5262025-03-25T01:19:31.772ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:09:31.732824967 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5272025-03-25T01:19:31.773ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 41.674316ms iteration = 1 status = {"expiration":"2025-03-25T01:09:31.732824967Z","pruned":[]}
5282025-03-25T01:19:31.806ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 74.408935ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5292025-03-25T01:19:31.828ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 875, tv_nsec: 548190152 } })
5302025-03-25T01:19:31.829ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
5312025-03-25T01:19:31.840ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322025-03-25T01:19:31.842ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332025-03-25T01:19:31.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5342025-03-25T01:19:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5352025-03-25T01:19:31.844ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5362025-03-25T01:19:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5372025-03-25T01:19:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5382025-03-25T01:19:31.846ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5392025-03-25T01:19:31.846ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
5402025-03-25T01:19:31.846ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 115.008276ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
5412025-03-25T01:19:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5422025-03-25T01:19:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5432025-03-25T01:19:31.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5442025-03-25T01:19:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5452025-03-25T01:19:31.850ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5462025-03-25T01:19:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5472025-03-25T01:19:31.854ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5482025-03-25T01:19:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5492025-03-25T01:19:31.856ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5502025-03-25T01:19:31.858ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5512025-03-25T01:19:31.858ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5522025-03-25T01:19:31.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5532025-03-25T01:19:31.859ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5542025-03-25T01:19:31.862ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5552025-03-25T01:19:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
5562025-03-25T01:19:31.862ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
5572025-03-25T01:19:31.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
5582025-03-25T01:19:31.863ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
5592025-03-25T01:19:31.864ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 875, tv_nsec: 583457976 } })
5602025-03-25T01:19:31.865ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5612025-03-25T01:19:31.867ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 135.261556ms iteration = 1 status = {"errors":[],"requests_created_ok":[]}
5622025-03-25T01:19:31.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5632025-03-25T01:19:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5642025-03-25T01:19:31.868ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
5652025-03-25T01:19:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5662025-03-25T01:19:31.872ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 141.454794ms iteration = 1 status = {}
5672025-03-25T01:19:31.873ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5682025-03-25T01:19:31.873ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5692025-03-25T01:19:31.873ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5702025-03-25T01:19:31.873ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
5712025-03-25T01:19:31.873ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 141.784899ms iteration = 1 status = {"error":"rack not yet initialized: 16a011db-af85-49cc-8fa6-b468f46a78bd"}
5722025-03-25T01:19:31.873ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5732025-03-25T01:19:31.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5742025-03-25T01:19:31.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5752025-03-25T01:19:31.889ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762025-03-25T01:19:31.889ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5772025-03-25T01:19:31.890ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 875, tv_nsec: 609753693 } })
5782025-03-25T01:19:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5792025-03-25T01:19:31.890ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
5802025-03-25T01:19:31.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
5812025-03-25T01:19:31.892ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
5822025-03-25T01:19:31.892ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
5832025-03-25T01:19:31.892ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5842025-03-25T01:19:31.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
5852025-03-25T01:19:31.893ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6f84e87a-357e-4d59-a3f4-a0e1ce5899c2", "content-length": "26", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
5862025-03-25T01:19:31.894ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5872025-03-25T01:19:31.895ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5882025-03-25T01:19:31.897ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
5892025-03-25T01:19:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5902025-03-25T01:19:31.901ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5912025-03-25T01:19:31.901ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 169.932382ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5922025-03-25T01:19:31.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
5932025-03-25T01:19:31.903ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5942025-03-25T01:19:31.903ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5952025-03-25T01:19:31.903ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 171.499724ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5962025-03-25T01:19:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5972025-03-25T01:19:31.926ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
5982025-03-25T01:19:31.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5992025-03-25T01:19:31.933ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 201.345512ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6002025-03-25T01:19:31.943ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6012025-03-25T01:19:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6022025-03-25T01:19:31.947ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6032025-03-25T01:19:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6042025-03-25T01:19:31.948ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
6052025-03-25T01:19:31.948ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
6062025-03-25T01:19:31.948ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 217.543873ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
6072025-03-25T01:19:31.949ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:94
6082025-03-25T01:19:31.949ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 218.02732ms iteration = 1 status = {"error":"inventory collection is None"}
6092025-03-25T01:19:31.955ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6102025-03-25T01:19:31.955ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 223.475108ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6112025-03-25T01:19:31.959ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 227.528736ms iteration = 1 status = {"errors":[],"finish_invoked_ok":[]}
6122025-03-25T01:19:31.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132025-03-25T01:19:31.965ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6142025-03-25T01:19:31.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6152025-03-25T01:19:31.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6162025-03-25T01:19:31.968ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6172025-03-25T01:19:31.968ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 236.998462ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6182025-03-25T01:19:31.969ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6192025-03-25T01:19:31.970ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 238.503422ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6202025-03-25T01:19:31.974ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6212025-03-25T01:19:31.974ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6222025-03-25T01:19:31.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6232025-03-25T01:19:31.978ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6242025-03-25T01:19:31.980ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
6252025-03-25T01:19:31.980ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
6262025-03-25T01:19:31.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
6272025-03-25T01:19:31.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
6282025-03-25T01:19:31.992ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
6292025-03-25T01:19:31.993ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 261.589553ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6302025-03-25T01:19:31.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
6312025-03-25T01:19:31.993ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6322025-03-25T01:19:31.993ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0f4ac30-0925-438a-b9b8-199c89ef320e", "content-length": "26", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6332025-03-25T01:19:31.994ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6342025-03-25T01:19:31.994ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6352025-03-25T01:19:31.994ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6362025-03-25T01:19:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6372025-03-25T01:19:31.994ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6382025-03-25T01:19:31.996ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6392025-03-25T01:19:31.996ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6402025-03-25T01:19:31.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6412025-03-25T01:19:31.997ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6422025-03-25T01:19:31.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6432025-03-25T01:19:31.998ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6442025-03-25T01:19:31.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6452025-03-25T01:19:32.000ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6462025-03-25T01:19:32.005ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6472025-03-25T01:19:32.005ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6482025-03-25T01:19:32.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6492025-03-25T01:19:32.008ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6502025-03-25T01:19:32.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6512025-03-25T01:19:32.010ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6522025-03-25T01:19:32.010ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 278.544826ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6532025-03-25T01:19:32.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6542025-03-25T01:19:32.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6552025-03-25T01:19:32.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562025-03-25T01:19:32.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6572025-03-25T01:19:32.018ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6582025-03-25T01:19:32.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6592025-03-25T01:19:32.024ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6602025-03-25T01:19:32.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6612025-03-25T01:19:32.026ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
6622025-03-25T01:19:32.026ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 294.86952ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
6632025-03-25T01:19:32.027ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 295.506398ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6642025-03-25T01:19:32.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6652025-03-25T01:19:32.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6662025-03-25T01:19:32.033ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6672025-03-25T01:19:32.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6682025-03-25T01:19:32.036ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6692025-03-25T01:19:32.037ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6702025-03-25T01:19:32.037ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 305.864787ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6712025-03-25T01:19:32.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6722025-03-25T01:19:32.039ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6732025-03-25T01:19:32.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742025-03-25T01:19:32.053ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6752025-03-25T01:19:32.053ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6762025-03-25T01:19:32.053ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6772025-03-25T01:19:32.059ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf9462d8-c086-4b80-a44f-5377850807d2", "content-length": "476", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6782025-03-25T01:19:32.064ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6792025-03-25T01:19:32.065ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab07c32e-c4e7-4041-9f35-60e2cd64b147", "content-length": "734", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
6802025-03-25T01:19:32.067ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6812025-03-25T01:19:32.067ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "06c77321-958c-4cf3-bf66-b6c447513276", "content-length": "111", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6822025-03-25T01:19:32.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6832025-03-25T01:19:32.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad8742c-6695-43c0-8ecb-d15692b56497", "content-length": "111", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6842025-03-25T01:19:32.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6852025-03-25T01:19:32.068ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6862025-03-25T01:19:32.068ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3949f0-ca34-4f8a-a6f2-db520e4aeb4f", "content-length": "167", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6872025-03-25T01:19:32.068ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6882025-03-25T01:19:32.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab91edd8-c343-4ed7-9c83-14276a6f1495", "content-length": "167", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6892025-03-25T01:19:32.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6902025-03-25T01:19:32.069ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "01da051b-839b-4709-8c77-2f89c6695ec5", "content-length": "175", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6912025-03-25T01:19:32.069ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6922025-03-25T01:19:32.070ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc576e6b-24d0-474e-9ed6-3326a5e8af1f", "content-length": "175", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6932025-03-25T01:19:32.070ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6942025-03-25T01:19:32.070ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37c86f85-5cb8-4490-818d-2e5347c996af", "content-length": "1", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6952025-03-25T01:19:32.070ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf04b9c9-eb7b-48ed-b01c-160d43f2250a", "content-length": "702", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6962025-03-25T01:19:32.070ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6972025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "04a1bcd5-0480-4a80-9723-039ce57a91bd", "content-length": "727", "date": "Tue, 25 Mar 2025 01:19:31 GMT"} })
6982025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6992025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "376ef67e-d3cc-4280-8c72-e8ecd669516c", "content-length": "729", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7002025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
7012025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7022025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfd92330-d556-4c03-aa3e-7c8d742ee898", "content-length": "728", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7032025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
7042025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7052025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "486e5150-5053-4965-b265-092c2def13a7", "content-length": "722", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7062025-03-25T01:19:32.071ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
7072025-03-25T01:19:32.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "924b8264-6707-46a9-be9c-89700c4670eb", "content-length": "109", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7082025-03-25T01:19:32.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
7092025-03-25T01:19:32.072ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd4b972e-3259-415e-9500-fa5ac274497e", "content-length": "109", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7102025-03-25T01:19:32.072ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
7112025-03-25T01:19:32.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b221ebec-271b-4c89-aa43-3e68940cd84f", "content-length": "169", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7122025-03-25T01:19:32.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
7132025-03-25T01:19:32.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "6076530e-ac7f-4fbb-b742-1ee3c49d14fb", "content-length": "169", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7142025-03-25T01:19:32.073ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
7152025-03-25T01:19:32.073ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2d92e4a-d85d-4f50-9f16-9c612ffb52cf", "content-length": "178", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7162025-03-25T01:19:32.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
7172025-03-25T01:19:32.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f32f87d7-b3a0-42c5-aee4-71ab6ab300fe", "content-length": "178", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7182025-03-25T01:19:32.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
7192025-03-25T01:19:32.074ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d03b9b3a-2ebc-4f72-a7f3-5a608e003cad", "content-length": "702", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7202025-03-25T01:19:32.074ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7212025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "85c95582-358e-46db-96c9-a6708a28ae62", "content-length": "727", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7222025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7232025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "370d981a-0fd4-4276-b539-73954ea095fd", "content-length": "729", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7242025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
7252025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cf8b7b9-dbae-4eb1-88c5-0cd2457f3156", "content-length": "728", "date": "Tue, 25 Mar 2025 01:19:32 GMT"} })
7262025-03-25T01:19:32.075ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7272025-03-25T01:19:32.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7282025-03-25T01:19:32.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7292025-03-25T01:19:32.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7302025-03-25T01:19:32.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7312025-03-25T01:19:32.082ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7322025-03-25T01:19:32.082ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7332025-03-25T01:19:32.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7342025-03-25T01:19:32.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 358.269336ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
7352025-03-25T01:19:32.094ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 362.904443ms iteration = 1 status = {}
7362025-03-25T01:19:32.100ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 368.515123ms iteration = 1 status = {}
7372025-03-25T01:19:32.102ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7382025-03-25T01:19:32.102ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7392025-03-25T01:19:32.102ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 370.36679ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7402025-03-25T01:19:32.111ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7412025-03-25T01:19:32.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422025-03-25T01:19:32.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7432025-03-25T01:19:32.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
7442025-03-25T01:19:32.116ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
7452025-03-25T01:19:32.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
7462025-03-25T01:19:32.116ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7472025-03-25T01:19:32.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7482025-03-25T01:19:32.118ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7492025-03-25T01:19:32.118ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7502025-03-25T01:19:32.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
7512025-03-25T01:19:32.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7522025-03-25T01:19:32.122ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7532025-03-25T01:19:32.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7542025-03-25T01:19:32.123ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7552025-03-25T01:19:32.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7562025-03-25T01:19:32.130ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7572025-03-25T01:19:32.130ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 399.251543ms iteration = 1 status = null
7582025-03-25T01:19:32.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592025-03-25T01:19:32.130ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7602025-03-25T01:19:32.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7612025-03-25T01:19:32.134ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622025-03-25T01:19:32.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632025-03-25T01:19:32.137ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642025-03-25T01:19:32.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7652025-03-25T01:19:32.139ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7662025-03-25T01:19:32.141ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7672025-03-25T01:19:32.141ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7682025-03-25T01:19:32.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7692025-03-25T01:19:32.148ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7702025-03-25T01:19:32.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7712025-03-25T01:19:32.189ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
7722025-03-25T01:19:32.189ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 457.803861ms iteration = 1 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
7732025-03-25T01:19:32.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742025-03-25T01:19:32.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752025-03-25T01:19:32.206ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7762025-03-25T01:19:32.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7772025-03-25T01:19:32.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7782025-03-25T01:19:32.212ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7792025-03-25T01:19:32.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7802025-03-25T01:19:32.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7812025-03-25T01:19:32.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7822025-03-25T01:19:32.215ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
7832025-03-25T01:19:32.215ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
7842025-03-25T01:19:32.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
7852025-03-25T01:19:32.229ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 497.272596ms iteration = 1 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":0,"put_config_err":0,"put_config_ok":0,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[]}
7862025-03-25T01:19:32.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7872025-03-25T01:19:32.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7882025-03-25T01:19:32.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7892025-03-25T01:19:32.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7902025-03-25T01:19:32.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7912025-03-25T01:19:32.265ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7922025-03-25T01:19:32.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7932025-03-25T01:19:32.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7942025-03-25T01:19:32.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7952025-03-25T01:19:32.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7962025-03-25T01:19:32.277ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7972025-03-25T01:19:32.277ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
7982025-03-25T01:19:32.277ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7992025-03-25T01:19:32.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8002025-03-25T01:19:32.279ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8012025-03-25T01:19:32.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8022025-03-25T01:19:32.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8032025-03-25T01:19:32.280ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8042025-03-25T01:19:32.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8052025-03-25T01:19:32.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8062025-03-25T01:19:32.283ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8072025-03-25T01:19:32.283ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8082025-03-25T01:19:32.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8092025-03-25T01:19:32.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8102025-03-25T01:19:32.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8112025-03-25T01:19:32.286ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8122025-03-25T01:19:32.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8132025-03-25T01:19:32.288ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8142025-03-25T01:19:32.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8152025-03-25T01:19:32.290ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8162025-03-25T01:19:32.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8172025-03-25T01:19:32.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8182025-03-25T01:19:32.305ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8192025-03-25T01:19:32.305ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8202025-03-25T01:19:32.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8212025-03-25T01:19:32.307ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8222025-03-25T01:19:32.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8232025-03-25T01:19:32.309ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8242025-03-25T01:19:32.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8252025-03-25T01:19:32.314ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8262025-03-25T01:19:32.318ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
8272025-03-25T01:19:32.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8282025-03-25T01:19:32.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8292025-03-25T01:19:32.329ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
8302025-03-25T01:19:32.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8312025-03-25T01:19:32.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8322025-03-25T01:19:32.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8332025-03-25T01:19:32.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
8342025-03-25T01:19:32.334ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
8352025-03-25T01:19:32.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
8362025-03-25T01:19:32.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8372025-03-25T01:19:32.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8382025-03-25T01:19:32.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8392025-03-25T01:19:32.339ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8402025-03-25T01:19:32.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8412025-03-25T01:19:32.340ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8422025-03-25T01:19:32.341ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8432025-03-25T01:19:32.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8442025-03-25T01:19:32.342ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8452025-03-25T01:19:32.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8462025-03-25T01:19:32.344ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 613.009151ms iteration = 1 status = {}
8472025-03-25T01:19:32.361ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
8482025-03-25T01:19:32.361ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
8492025-03-25T01:19:32.361ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
8502025-03-25T01:19:32.522ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8512025-03-25T01:19:32.522ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8522025-03-25T01:19:32.522ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8532025-03-25T01:19:32.522ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 789.393035ms
8542025-03-25T01:19:32.522ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 790.38417ms iteration = 1 status = {}
8552025-03-25T01:19:32.585ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 62d85891-6bcf-47fd-99f3-6240c711b229 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
8562025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 62d85891-6bcf-47fd-99f3-6240c711b229 time_started = 2025-03-25 01:19:32.044640 UTC
8572025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 2 reason = Dependency
8582025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 854.282584ms iteration = 1 status = {"collection_id":"62d85891-6bcf-47fd-99f3-6240c711b229","time_done":"2025-03-25 01:19:32.277509 UTC","time_started":"2025-03-25 01:19:32.044640 UTC"}
8592025-03-25T01:19:32.585ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
8602025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8612025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 16.56\u{b5}s iteration = 2 status = {"error":"no blueprint"}
8622025-03-25T01:19:32.585ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8632025-03-25T01:19:32.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8642025-03-25T01:19:32.587ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8652025-03-25T01:19:32.589ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8662025-03-25T01:19:32.589ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8672025-03-25T01:19:32.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8682025-03-25T01:19:32.591ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
8692025-03-25T01:19:32.591ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.355887ms iteration = 2 status = {"error":"rack not yet initialized: 16a011db-af85-49cc-8fa6-b468f46a78bd"}
8702025-03-25T01:19:33.647ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8712025-03-25T01:19:33.647ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8722025-03-25T01:19:33.649ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8732025-03-25T01:19:33.649ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8742025-03-25T01:19:33.651ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8752025-03-25T01:19:33.654ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
8762025-03-25T01:19:33.654ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
8772025-03-25T01:19:35.655ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8782025-03-25T01:19:35.655ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8792025-03-25T01:19:35.657ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8802025-03-25T01:19:35.657ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8812025-03-25T01:19:35.659ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8822025-03-25T01:19:35.661ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
8832025-03-25T01:19:35.661ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
8842025-03-25T01:19:37.661ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8852025-03-25T01:19:37.662ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8862025-03-25T01:19:37.664ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8872025-03-25T01:19:37.664ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8882025-03-25T01:19:37.665ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8892025-03-25T01:19:37.668ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
8902025-03-25T01:19:37.668ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
8912025-03-25T01:19:39.669ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8922025-03-25T01:19:39.669ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8932025-03-25T01:19:39.671ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8942025-03-25T01:19:39.672ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
8952025-03-25T01:19:39.673ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8962025-03-25T01:19:39.675ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
8972025-03-25T01:19:39.675ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
8982025-03-25T01:19:41.677ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
8992025-03-25T01:19:41.677ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9002025-03-25T01:19:41.679ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9012025-03-25T01:19:41.680ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9022025-03-25T01:19:41.681ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9032025-03-25T01:19:41.684ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9042025-03-25T01:19:41.684ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9052025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
9062025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9072025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9082025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
9092025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9102025-03-25T01:19:41.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9112025-03-25T01:19:41.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9122025-03-25T01:19:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9132025-03-25T01:19:41.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9142025-03-25T01:19:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9152025-03-25T01:19:41.737ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9162025-03-25T01:19:41.737ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.508973ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9172025-03-25T01:19:41.761ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9182025-03-25T01:19:41.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9192025-03-25T01:19:41.796ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.34507ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9202025-03-25T01:19:43.685ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9212025-03-25T01:19:43.685ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9222025-03-25T01:19:43.687ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9232025-03-25T01:19:43.687ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9242025-03-25T01:19:43.689ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9252025-03-25T01:19:43.691ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9262025-03-25T01:19:43.691ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9272025-03-25T01:19:45.692ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9282025-03-25T01:19:45.692ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9292025-03-25T01:19:45.694ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9302025-03-25T01:19:45.694ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9312025-03-25T01:19:45.696ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9322025-03-25T01:19:45.698ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9332025-03-25T01:19:45.698ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9342025-03-25T01:19:47.699ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9352025-03-25T01:19:47.700ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9362025-03-25T01:19:47.701ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9372025-03-25T01:19:47.701ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9382025-03-25T01:19:47.703ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9392025-03-25T01:19:47.705ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9402025-03-25T01:19:47.705ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9412025-03-25T01:19:49.707ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9422025-03-25T01:19:49.708ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9432025-03-25T01:19:49.709ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9442025-03-25T01:19:49.710ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9452025-03-25T01:19:49.711ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9462025-03-25T01:19:49.713ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9472025-03-25T01:19:49.713ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9482025-03-25T01:19:51.713ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9492025-03-25T01:19:51.714ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9502025-03-25T01:19:51.715ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9512025-03-25T01:19:51.715ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9522025-03-25T01:19:51.717ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9532025-03-25T01:19:51.719ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9542025-03-25T01:19:51.719ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9552025-03-25T01:19:51.730ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
9562025-03-25T01:19:51.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9572025-03-25T01:19:51.731ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9582025-03-25T01:19:51.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
9592025-03-25T01:19:51.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9602025-03-25T01:19:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9612025-03-25T01:19:51.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9622025-03-25T01:19:51.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
9632025-03-25T01:19:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
9642025-03-25T01:19:51.735ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.700343ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
9652025-03-25T01:19:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
9662025-03-25T01:19:51.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
9672025-03-25T01:19:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
9682025-03-25T01:19:51.737ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
9692025-03-25T01:19:51.737ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 6.893299ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
9702025-03-25T01:19:53.720ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9712025-03-25T01:19:53.721ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9722025-03-25T01:19:53.722ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9732025-03-25T01:19:53.722ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9742025-03-25T01:19:53.726ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9752025-03-25T01:19:53.729ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9762025-03-25T01:19:53.729ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9772025-03-25T01:19:55.730ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9782025-03-25T01:19:55.730ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9792025-03-25T01:19:55.732ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9802025-03-25T01:19:55.732ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9812025-03-25T01:19:55.733ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822025-03-25T01:19:55.736ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9832025-03-25T01:19:55.736ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9842025-03-25T01:19:57.737ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9852025-03-25T01:19:57.737ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9862025-03-25T01:19:57.738ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9872025-03-25T01:19:57.739ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9882025-03-25T01:19:57.740ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9892025-03-25T01:19:57.742ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9902025-03-25T01:19:57.742ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9912025-03-25T01:19:59.744ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9922025-03-25T01:19:59.745ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9932025-03-25T01:19:59.746ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9942025-03-25T01:19:59.746ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9952025-03-25T01:19:59.748ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9962025-03-25T01:19:59.750ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
9972025-03-25T01:19:59.750ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
9982025-03-25T01:20:01.731ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
9992025-03-25T01:20:01.731ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
10002025-03-25T01:20:01.731ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10012025-03-25T01:20:01.731ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
10022025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
10032025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
10042025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
10052025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
10062025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
10072025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
10082025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
10092025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 2 reason = Timeout
10102025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
10112025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
10122025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10132025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10142025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10152025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
10162025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10172025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
10182025-03-25T01:20:01.732ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
10192025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10202025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
10212025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
10222025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
10232025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
10242025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
10252025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
10262025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10272025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
10282025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
10292025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
10302025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
10312025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
10322025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
10332025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 2 reason = Timeout
10342025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
10352025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
10362025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
10372025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10382025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
10392025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
10402025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10412025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10422025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
10432025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10442025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10452025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
10462025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10472025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
10482025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10492025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
10502025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
10512025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
10522025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
10532025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
10542025-03-25T01:20:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
10552025-03-25T01:20:01.735ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10562025-03-25T01:20:01.737ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 905, tv_nsec: 456044063 } })
10572025-03-25T01:20:01.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
10582025-03-25T01:20:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
10592025-03-25T01:20:01.738ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
10602025-03-25T01:20:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
10612025-03-25T01:20:01.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10622025-03-25T01:20:01.739ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 7.332785ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
10632025-03-25T01:20:01.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10642025-03-25T01:20:01.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10652025-03-25T01:20:01.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10662025-03-25T01:20:01.741ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10672025-03-25T01:20:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
10682025-03-25T01:20:01.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
10692025-03-25T01:20:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
10702025-03-25T01:20:01.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 905, tv_nsec: 462847571 } })
10712025-03-25T01:20:01.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
10722025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
10732025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
10742025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
10752025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
10762025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
10772025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10782025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10792025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
10802025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10812025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
10822025-03-25T01:20:01.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
10832025-03-25T01:20:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
10842025-03-25T01:20:01.745ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10852025-03-25T01:20:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
10862025-03-25T01:20:01.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
10872025-03-25T01:20:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
10882025-03-25T01:20:01.751ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10892025-03-25T01:20:01.751ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10902025-03-25T01:20:01.759ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 27.537244ms iteration = 2 status = {}
10912025-03-25T01:20:01.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10922025-03-25T01:20:01.763ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
10932025-03-25T01:20:01.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
10942025-03-25T01:20:01.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
10952025-03-25T01:20:01.764ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
10962025-03-25T01:20:01.764ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 32.449235ms iteration = 3 status = {"error":"rack not yet initialized: 16a011db-af85-49cc-8fa6-b468f46a78bd"}
10972025-03-25T01:20:01.764ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10982025-03-25T01:20:01.765ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10992025-03-25T01:20:01.768ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11002025-03-25T01:20:01.768ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 36.386331ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11012025-03-25T01:20:01.776ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
11022025-03-25T01:20:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
11032025-03-25T01:20:01.793ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
11042025-03-25T01:20:01.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
11052025-03-25T01:20:01.808ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11062025-03-25T01:20:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11072025-03-25T01:20:01.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11082025-03-25T01:20:01.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
11092025-03-25T01:20:01.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11102025-03-25T01:20:01.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11112025-03-25T01:20:01.812ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11122025-03-25T01:20:01.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 80.856057ms iteration = 2 status = {"errors":[],"finish_invoked_ok":[]}
11132025-03-25T01:20:01.813ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11142025-03-25T01:20:01.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
11152025-03-25T01:20:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
11162025-03-25T01:20:01.825ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
11172025-03-25T01:20:01.825ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11182025-03-25T01:20:01.825ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4b927304-c930-445e-ad89-cd00ffc6ad34", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:01 GMT"} })
11192025-03-25T01:20:01.825ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11202025-03-25T01:20:01.827ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11212025-03-25T01:20:01.828ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 96.060145ms iteration = 2 status = {"errors":[],"requests_created_ok":[]}
11222025-03-25T01:20:01.831ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11232025-03-25T01:20:01.833ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11242025-03-25T01:20:01.834ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.104151ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
11252025-03-25T01:20:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11262025-03-25T01:20:01.835ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
11272025-03-25T01:20:01.835ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
11282025-03-25T01:20:01.836ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11292025-03-25T01:20:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
11302025-03-25T01:20:01.839ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
11312025-03-25T01:20:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
11322025-03-25T01:20:01.843ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
11332025-03-25T01:20:01.843ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
11342025-03-25T01:20:01.843ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aac535ba-bd45-4dcc-ad85-b81b748e8f55", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:01 GMT"} })
11352025-03-25T01:20:01.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
11362025-03-25T01:20:01.844ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
11372025-03-25T01:20:01.845ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
11382025-03-25T01:20:01.845ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.840109ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
11392025-03-25T01:20:01.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 140.065434ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11402025-03-25T01:20:01.874ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11412025-03-25T01:20:01.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
11422025-03-25T01:20:01.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
11432025-03-25T01:20:01.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
11442025-03-25T01:20:01.876ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 144.584509ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11452025-03-25T01:20:01.876ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
11462025-03-25T01:20:01.877ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
11472025-03-25T01:20:01.877ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
11482025-03-25T01:20:01.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 145.299909ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
11492025-03-25T01:20:01.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
11502025-03-25T01:20:01.877ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.30847ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
11512025-03-25T01:20:01.881ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
11522025-03-25T01:20:01.881ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc14d35f-ba7f-4182-9d6a-ab39757e3675", "content-length": "1", "date": "Tue, 25 Mar 2025 01:20:01 GMT"} })
11532025-03-25T01:20:01.882ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
11542025-03-25T01:20:01.883ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
11552025-03-25T01:20:01.883ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 151.365386ms iteration = 2 status = {}
11562025-03-25T01:20:01.884ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 152.731915ms iteration = 2 status = null
11572025-03-25T01:20:01.890ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
11582025-03-25T01:20:01.890ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 158.386237ms iteration = 2 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
11592025-03-25T01:20:01.890ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 158.578479ms iteration = 2 status = {}
11602025-03-25T01:20:01.920ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11612025-03-25T01:20:01.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11622025-03-25T01:20:01.925ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 193.345277ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
11632025-03-25T01:20:02.007ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:256
11642025-03-25T01:20:02.007ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 275.873497ms iteration = 2 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
11652025-03-25T01:20:02.033ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11662025-03-25T01:20:02.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11672025-03-25T01:20:02.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11682025-03-25T01:20:02.049ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11692025-03-25T01:20:02.049ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11702025-03-25T01:20:02.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11712025-03-25T01:20:02.053ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11722025-03-25T01:20:02.054ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
11732025-03-25T01:20:02.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
11742025-03-25T01:20:02.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
11752025-03-25T01:20:02.065ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 334.006149ms iteration = 2 status = {}
11762025-03-25T01:20:03.562ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:65117
11772025-03-25T01:20:03.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 5fdb2279-a976-4427-a588-724f6f2ad086 roles = RoleSet { roles: {} } uri = /sled-agents/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11782025-03-25T01:20:03.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 5fdb2279-a976-4427-a588-724f6f2ad086 resource = Database result = Ok(()) uri = /sled-agents/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11792025-03-25T01:20:03.565ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "1768bc4c-c9ec-4fc7-a560-5ef338d49e99" error_message_internal = not found: sled with id "1768bc4c-c9ec-4fc7-a560-5ef338d49e99" file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:855 latency_us = 3733 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 5fdb2279-a976-4427-a588-724f6f2ad086 response_code = 404 uri = /sled-agents/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11802025-03-25T01:20:03.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = f59b82ea-2102-4bf6-9f92-c7ef6a9b7dc9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11812025-03-25T01:20:03.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = f59b82ea-2102-4bf6-9f92-c7ef6a9b7dc9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11822025-03-25T01:20:03.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 9977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = f59b82ea-2102-4bf6-9f92-c7ef6a9b7dc9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11832025-03-25T01:20:03.714ZINFOnexus: registered sled agent file = nexus/src/app/sled.rs:58 sled_uuid = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11842025-03-25T01:20:03.746ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
11852025-03-25T01:20:03.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 34082 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 68c8acff-94cc-4c51-8906-bc80bf9be4ca response_code = 204 uri = /sled-agents/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
11862025-03-25T01:20:03.746ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11872025-03-25T01:20:03.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11882025-03-25T01:20:03.748ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11892025-03-25T01:20:03.749ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
11902025-03-25T01:20:03.749ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
11912025-03-25T01:20:03.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
11922025-03-25T01:20:03.759ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1c088d7b-3651-47d3-a6e6-9d4eecf096cf, 0), (62d85891-6bcf-47fd-99f3-6240c711b229, 0), (1469a400-b88f-4d91-b4c3-6a7cd205b8d2, 0)]
11932025-03-25T01:20:03.759ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 907, tv_nsec: 478551383 } })
11942025-03-25T01:20:03.791ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
11952025-03-25T01:20:03.791ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
11962025-03-25T01:20:03.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
11972025-03-25T01:20:03.791ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "e42f99cd-c0b7-440e-8a43-d912407cbc96", "content-length": "476", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
11982025-03-25T01:20:03.791ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
11992025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25a2f6a-920b-41a8-9e80-617387964cdc", "content-length": "734", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12002025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
12012025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "4bf7cf99-225f-42d3-a058-85a29c33bf67", "content-length": "111", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12022025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
12032025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9631b82d-a350-4347-a0cb-eb635227d4e8", "content-length": "111", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12042025-03-25T01:20:03.792ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
12052025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a003dd94-6beb-40de-82e9-8977b7021d5e", "content-length": "167", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12062025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
12072025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd283668-4ecc-47d7-bb2f-8b4501dea165", "content-length": "167", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12082025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
12092025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f70978e-65ef-495f-8021-409666829aab", "content-length": "175", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12102025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
12112025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae1bdb38-cfee-49e3-b710-4aa88c2baa70", "content-length": "175", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12122025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
12132025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6eaf4977-81b7-4529-b63a-caee0db833be", "content-length": "702", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12142025-03-25T01:20:03.793ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12152025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ad138e8-cd58-4b08-ba03-17ad41f1c4c2", "content-length": "727", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12162025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12172025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "58ad10bd-057b-4f13-9ef0-b5cb29feb1ce", "content-length": "729", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12182025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
12192025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fa8a608-9f82-40c1-8572-2616c942b77f", "content-length": "728", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12202025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
12212025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d7ae163-5a34-4e1c-a3c0-3f00d5900fa2", "content-length": "722", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12222025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
12232025-03-25T01:20:03.794ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f90b4652-7303-45df-9397-3885a429f4e8", "content-length": "109", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12242025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
12252025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8bf3d90-b617-4b8e-b76b-e3ca1a2fce36", "content-length": "109", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12262025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
12272025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "32182611-b148-465f-bad3-c3d5816dbc29", "content-length": "169", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12282025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
12292025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8d2d41d-d50b-4066-9dec-8fda6d166b85", "content-length": "169", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12302025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
12312025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "828f0a4a-3e19-4c83-846c-c4857c88fc91", "content-length": "178", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12322025-03-25T01:20:03.795ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
12332025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "95547176-92d5-46da-a33b-5a914ee10b47", "content-length": "178", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12342025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
12352025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3476dc03-64cd-4b82-ac5c-5a967262ce30", "content-length": "702", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12362025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12372025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a529b1ef-8ce7-4805-9c1b-5df11eb97bed", "content-length": "727", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12382025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12392025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1a1dcb1d-827f-4bda-a00d-7696e1437868", "content-length": "729", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12402025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
12412025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6b57234-17b2-4d9e-bfd3-b76e043ab71e", "content-length": "728", "date": "Tue, 25 Mar 2025 01:20:03 GMT"} })
12422025-03-25T01:20:03.796ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12432025-03-25T01:20:03.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12442025-03-25T01:20:03.798ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12452025-03-25T01:20:03.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12462025-03-25T01:20:03.800ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12472025-03-25T01:20:03.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12482025-03-25T01:20:03.801ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12492025-03-25T01:20:03.803ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
12502025-03-25T01:20:03.803ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12512025-03-25T01:20:03.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12522025-03-25T01:20:03.836ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12532025-03-25T01:20:03.836ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12542025-03-25T01:20:03.838ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
12552025-03-25T01:20:03.838ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
12562025-03-25T01:20:03.838ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12572025-03-25T01:20:03.838ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12582025-03-25T01:20:03.839ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12592025-03-25T01:20:03.842ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
12602025-03-25T01:20:03.842ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
12612025-03-25T01:20:04.057ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d639a97-3684-48ba-b8b3-6f29d5059e77", "content-length": "31961", "date": "Tue, 25 Mar 2025 01:20:04 GMT"} })
12622025-03-25T01:20:04.060ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12632025-03-25T01:20:04.060ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
12642025-03-25T01:20:04.060ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
12652025-03-25T01:20:04.062ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12662025-03-25T01:20:04.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12672025-03-25T01:20:04.064ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682025-03-25T01:20:04.065ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
12692025-03-25T01:20:04.066ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
12702025-03-25T01:20:04.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
12712025-03-25T01:20:04.230ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 87d806d7-6486-48c2-9a46-fc8cd66e95f9 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
12722025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 87d806d7-6486-48c2-9a46-fc8cd66e95f9 time_started = 2025-03-25 01:20:03.791249 UTC
12732025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 484.608354ms iteration = 2 status = {"collection_id":"87d806d7-6486-48c2-9a46-fc8cd66e95f9","time_done":"2025-03-25 01:20:04.060317 UTC","time_started":"2025-03-25 01:20:03.791249 UTC"}
12742025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 3 reason = Dependency
12752025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
12762025-03-25T01:20:04.230ZWARNnexus (BackgroundTasks): Blueprint rendezvous: skipped background_task = blueprint_rendezvous file = nexus/src/app/background/tasks/blueprint_rendezvous.rs:52 reason = no blueprint
12772025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 21.93\u{b5}s iteration = 3 status = {"error":"no blueprint"}
12782025-03-25T01:20:04.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12792025-03-25T01:20:04.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12802025-03-25T01:20:04.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12812025-03-25T01:20:04.234ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
12822025-03-25T01:20:04.234ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
12832025-03-25T01:20:04.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
12842025-03-25T01:20:04.236ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
12852025-03-25T01:20:04.236ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.905815ms iteration = 4 status = {"error":"rack not yet initialized: 16a011db-af85-49cc-8fa6-b468f46a78bd"}
12862025-03-25T01:20:04.599ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 50c43bdc-f6e3-4341-b84c-0c5ca24176c0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12872025-03-25T01:20:04.599ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 50c43bdc-f6e3-4341-b84c-0c5ca24176c0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12882025-03-25T01:20:04.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2828 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:65117 req_id = 50c43bdc-f6e3-4341-b84c-0c5ca24176c0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12892025-03-25T01:20:04.901ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::1]:36658
12902025-03-25T01:20:05.620ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 088dad0c-c848-47f3-8214-272c9f768116 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12912025-03-25T01:20:05.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 088dad0c-c848-47f3-8214-272c9f768116 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12922025-03-25T01:20:05.623ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 088dad0c-c848-47f3-8214-272c9f768116 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
12932025-03-25T01:20:05.843ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12942025-03-25T01:20:05.843ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12952025-03-25T01:20:05.845ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12962025-03-25T01:20:05.845ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12972025-03-25T01:20:05.847ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12982025-03-25T01:20:05.849ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
12992025-03-25T01:20:05.849ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 16a011db-af85-49cc-8fa6-b468f46a78bd, time_created: 2025-03-25T01:19:31.657933Z, time_modified: 2025-03-25T01:19:31.657933Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:770
13002025-03-25T01:20:06.642ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = abec2e97-6d09-4ec4-ab1e-c70d8cb5cd76 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13012025-03-25T01:20:06.642ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = abec2e97-6d09-4ec4-ab1e-c70d8cb5cd76 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13022025-03-25T01:20:06.644ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2693 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = abec2e97-6d09-4ec4-ab1e-c70d8cb5cd76 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13032025-03-25T01:20:07.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f59ba49-3add-4bd4-839f-c1d100971fe3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13042025-03-25T01:20:07.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f59ba49-3add-4bd4-839f-c1d100971fe3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13052025-03-25T01:20:07.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f59ba49-3add-4bd4-839f-c1d100971fe3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
13062025-03-25T01:20:07.851ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13072025-03-25T01:20:07.851ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13082025-03-25T01:20:07.853ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13092025-03-25T01:20:07.853ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13102025-03-25T01:20:07.854ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13112025-03-25T01:20:07.857ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 16a011db-af85-49cc-8fa6-b468f46a78bd, lookup_type: ById(16a011db-af85-49cc-8fa6-b468f46a78bd) } result = Ok(())
13122025-03-25T01:20:07.857ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:767
13132025-03-25T01:20:07.857ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13142025-03-25T01:20:07.857ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13152025-03-25T01:20:07.859ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13162025-03-25T01:20:07.859ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13172025-03-25T01:20:07.860ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13182025-03-25T01:20:07.861ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13192025-03-25T01:20:07.862ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13202025-03-25T01:20:07.863ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13212025-03-25T01:20:07.864ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13222025-03-25T01:20:07.864ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13232025-03-25T01:20:07.865ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13242025-03-25T01:20:07.865ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13252025-03-25T01:20:07.866ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13262025-03-25T01:20:07.869ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13272025-03-25T01:20:07.869ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13282025-03-25T01:20:07.870ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13292025-03-25T01:20:07.871ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13302025-03-25T01:20:07.871ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13312025-03-25T01:20:07.872ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13322025-03-25T01:20:07.873ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13332025-03-25T01:20:07.874ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13342025-03-25T01:20:07.877ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13352025-03-25T01:20:07.877ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13362025-03-25T01:20:07.877ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13372025-03-25T01:20:07.879ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13382025-03-25T01:20:07.879ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13392025-03-25T01:20:07.880ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13402025-03-25T01:20:07.881ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13412025-03-25T01:20:07.882ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13422025-03-25T01:20:07.882ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13432025-03-25T01:20:07.883ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13442025-03-25T01:20:07.883ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13452025-03-25T01:20:07.885ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13462025-03-25T01:20:07.885ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13472025-03-25T01:20:07.886ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13482025-03-25T01:20:07.886ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13492025-03-25T01:20:07.888ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13502025-03-25T01:20:07.890ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
13512025-03-25T01:20:07.890ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13522025-03-25T01:20:07.890ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13532025-03-25T01:20:07.891ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13542025-03-25T01:20:07.892ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13552025-03-25T01:20:07.893ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13562025-03-25T01:20:07.893ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13572025-03-25T01:20:07.895ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13582025-03-25T01:20:07.895ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13592025-03-25T01:20:07.898ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13602025-03-25T01:20:07.898ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13612025-03-25T01:20:07.899ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13622025-03-25T01:20:07.899ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13632025-03-25T01:20:07.900ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13642025-03-25T01:20:07.900ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13652025-03-25T01:20:07.902ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13662025-03-25T01:20:07.905ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13672025-03-25T01:20:07.905ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13682025-03-25T01:20:07.905ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13692025-03-25T01:20:07.906ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13702025-03-25T01:20:07.907ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13712025-03-25T01:20:07.908ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13722025-03-25T01:20:07.908ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13732025-03-25T01:20:07.909ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13742025-03-25T01:20:07.912ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
13752025-03-25T01:20:07.913ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13762025-03-25T01:20:07.913ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13772025-03-25T01:20:07.916ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13782025-03-25T01:20:07.916ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13792025-03-25T01:20:07.918ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13802025-03-25T01:20:07.918ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13812025-03-25T01:20:07.920ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13822025-03-25T01:20:07.920ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13832025-03-25T01:20:07.922ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13842025-03-25T01:20:07.922ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13852025-03-25T01:20:07.924ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13862025-03-25T01:20:07.924ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13872025-03-25T01:20:07.925ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13882025-03-25T01:20:07.925ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13892025-03-25T01:20:07.927ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13902025-03-25T01:20:07.927ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13912025-03-25T01:20:07.928ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13922025-03-25T01:20:07.932ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
13932025-03-25T01:20:07.932ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13942025-03-25T01:20:07.932ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13952025-03-25T01:20:07.933ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13962025-03-25T01:20:07.933ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13972025-03-25T01:20:07.935ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
13982025-03-25T01:20:07.935ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
13992025-03-25T01:20:07.936ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14002025-03-25T01:20:07.939ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
14012025-03-25T01:20:07.939ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14022025-03-25T01:20:07.940ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14032025-03-25T01:20:07.947ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
14042025-03-25T01:20:07.947ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14052025-03-25T01:20:07.947ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14062025-03-25T01:20:07.948ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14072025-03-25T01:20:07.950ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
14082025-03-25T01:20:07.950ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14092025-03-25T01:20:07.950ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14102025-03-25T01:20:07.952ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
14112025-03-25T01:20:07.954ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
14122025-03-25T01:20:07.954ZDEBGnexus (InternalApi): resolved 2 rules for sleds
14132025-03-25T01:20:08.012ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, time_created: 2025-03-25T01:20:03.714241Z, time_modified: 2025-03-25T01:20:03.714241Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
14142025-03-25T01:20:08.012ZDEBGnexus (InternalApi): sending firewall rules to sled agents
14152025-03-25T01:20:08.012ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14162025-03-25T01:20:08.012ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14172025-03-25T01:20:08.014ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
14182025-03-25T01:20:08.015ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
14192025-03-25T01:20:08.016ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14202025-03-25T01:20:08.019ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
14212025-03-25T01:20:08.050ZDEBGnexus (InternalApi): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
14222025-03-25T01:20:08.051ZDEBGnexus (InternalApi): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "c3157cba-02a5-484f-a076-8f59ee5e4feb", "date": "Tue, 25 Mar 2025 01:20:07 GMT"} })
14232025-03-25T01:20:08.051ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
14242025-03-25T01:20:08.051ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
14252025-03-25T01:20:08.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b238a9f7-006a-4cf8-9806-1490219a3e11 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14262025-03-25T01:20:08.691ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b238a9f7-006a-4cf8-9806-1490219a3e11 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14272025-03-25T01:20:08.693ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2381 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b238a9f7-006a-4cf8-9806-1490219a3e11 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14282025-03-25T01:20:09.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac90786c-198a-4071-8241-e9259183fa6b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14292025-03-25T01:20:09.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac90786c-198a-4071-8241-e9259183fa6b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14302025-03-25T01:20:09.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac90786c-198a-4071-8241-e9259183fa6b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14312025-03-25T01:20:10.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f2cc2dc-4119-4fc1-a5d5-574cfaaf2766 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14322025-03-25T01:20:10.737ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f2cc2dc-4119-4fc1-a5d5-574cfaaf2766 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14332025-03-25T01:20:10.739ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f2cc2dc-4119-4fc1-a5d5-574cfaaf2766 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14342025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
14352025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14362025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14372025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
14382025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14392025-03-25T01:20:11.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14402025-03-25T01:20:11.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14412025-03-25T01:20:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14422025-03-25T01:20:11.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14432025-03-25T01:20:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14442025-03-25T01:20:11.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14452025-03-25T01:20:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14462025-03-25T01:20:11.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14472025-03-25T01:20:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
14482025-03-25T01:20:11.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14492025-03-25T01:20:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14502025-03-25T01:20:11.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e38c7090-5612-4553-9248-127fb122d210 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14512025-03-25T01:20:11.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e38c7090-5612-4553-9248-127fb122d210 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14522025-03-25T01:20:11.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1961 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e38c7090-5612-4553-9248-127fb122d210 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14532025-03-25T01:20:11.763ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
14542025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.153405ms iteration = 5 status = {"enabled":false,"status":"first target blueprint","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z","time_found":"2025-03-25T01:20:11.763264795Z"}
14552025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
14562025-03-25T01:20:11.763ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
14572025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
14582025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.56\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
14592025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14602025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14612025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14622025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14632025-03-25T01:20:11.763ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14642025-03-25T01:20:11.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14652025-03-25T01:20:11.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14662025-03-25T01:20:11.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14672025-03-25T01:20:11.764ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14682025-03-25T01:20:11.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14692025-03-25T01:20:11.766ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14702025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14712025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14722025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14732025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14742025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14752025-03-25T01:20:11.768ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14762025-03-25T01:20:11.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14772025-03-25T01:20:11.769ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14782025-03-25T01:20:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14792025-03-25T01:20:11.770ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14802025-03-25T01:20:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14812025-03-25T01:20:11.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14822025-03-25T01:20:11.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.086379ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
14832025-03-25T01:20:11.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14842025-03-25T01:20:11.771ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14852025-03-25T01:20:11.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14862025-03-25T01:20:11.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14872025-03-25T01:20:11.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14882025-03-25T01:20:11.773ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14892025-03-25T01:20:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
14902025-03-25T01:20:11.775ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
14912025-03-25T01:20:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
14922025-03-25T01:20:11.811ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
14932025-03-25T01:20:11.841ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
14942025-03-25T01:20:11.872ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
14952025-03-25T01:20:11.906ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
14962025-03-25T01:20:11.938ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
14972025-03-25T01:20:12.781ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35635593-320f-4ee3-8747-d7515cf20bbf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14982025-03-25T01:20:12.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35635593-320f-4ee3-8747-d7515cf20bbf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
14992025-03-25T01:20:12.783ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2497 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35635593-320f-4ee3-8747-d7515cf20bbf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15002025-03-25T01:20:12.857ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8345c968-c875-4d78-acba-660f9f309bb3", "content-length": "64", "date": "Tue, 25 Mar 2025 01:20:12 GMT"} })
15012025-03-25T01:20:12.857ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15022025-03-25T01:20:12.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15032025-03-25T01:20:12.859ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15042025-03-25T01:20:12.860ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15052025-03-25T01:20:12.860ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15062025-03-25T01:20:12.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15072025-03-25T01:20:12.870ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e958ee9-2758-4bef-8dbf-87f47bbdd0c1", "content-length": "64", "date": "Tue, 25 Mar 2025 01:20:11 GMT"} })
15082025-03-25T01:20:12.870ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15092025-03-25T01:20:12.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15102025-03-25T01:20:12.873ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15112025-03-25T01:20:12.874ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15122025-03-25T01:20:12.874ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15132025-03-25T01:20:12.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15142025-03-25T01:20:12.877ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c9ff2964-41ae-4b8d-b971-81fa6b808267", "content-length": "64", "date": "Tue, 25 Mar 2025 01:20:12 GMT"} })
15152025-03-25T01:20:12.877ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15162025-03-25T01:20:12.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15172025-03-25T01:20:12.879ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15182025-03-25T01:20:12.881ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15192025-03-25T01:20:12.881ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15202025-03-25T01:20:12.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15212025-03-25T01:20:12.911ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb4f9cff-7800-4592-a3f5-b18a41a0c4d6", "content-length": "64", "date": "Tue, 25 Mar 2025 01:20:12 GMT"} })
15222025-03-25T01:20:12.911ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15232025-03-25T01:20:12.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15242025-03-25T01:20:12.914ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15252025-03-25T01:20:12.915ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15262025-03-25T01:20:12.915ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15272025-03-25T01:20:12.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15282025-03-25T01:20:12.931ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b71a85cf-06db-4cbe-be4b-fff27c5416c5", "content-length": "64", "date": "Tue, 25 Mar 2025 01:20:12 GMT"} })
15292025-03-25T01:20:12.931ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15302025-03-25T01:20:12.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15312025-03-25T01:20:12.933ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15322025-03-25T01:20:12.934ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
15332025-03-25T01:20:12.934ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
15342025-03-25T01:20:12.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
15352025-03-25T01:20:12.941ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.177686881s iteration = 2 status = {"nsuccess":5}
15362025-03-25T01:20:13.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 43fe3292-5555-4bde-9528-b68fffdc4a72 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15372025-03-25T01:20:13.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 43fe3292-5555-4bde-9528-b68fffdc4a72 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15382025-03-25T01:20:13.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2112 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 43fe3292-5555-4bde-9528-b68fffdc4a72 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15392025-03-25T01:20:14.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9f03f27-f091-4747-988e-b92add3f9b14 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15402025-03-25T01:20:14.825ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9f03f27-f091-4747-988e-b92add3f9b14 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15412025-03-25T01:20:14.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2418 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9f03f27-f091-4747-988e-b92add3f9b14 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15422025-03-25T01:20:15.751ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:40535
15432025-03-25T01:20:15.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 38a5abfd-b124-40f1-a95b-0b9e5965553b roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
15442025-03-25T01:20:15.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 38a5abfd-b124-40f1-a95b-0b9e5965553b resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
15452025-03-25T01:20:15.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3550 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 38a5abfd-b124-40f1-a95b-0b9e5965553b response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
15462025-03-25T01:20:15.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 7cc1981b-6584-4e40-905e-5a2915f68d2d roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
15472025-03-25T01:20:15.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 7cc1981b-6584-4e40-905e-5a2915f68d2d resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
15482025-03-25T01:20:15.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3958 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:40535 req_id = 7cc1981b-6584-4e40-905e-5a2915f68d2d response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
15492025-03-25T01:20:15.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ce33ccb7-2ede-4caf-af4b-2335667f8cd0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15502025-03-25T01:20:15.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ce33ccb7-2ede-4caf-af4b-2335667f8cd0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15512025-03-25T01:20:15.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ce33ccb7-2ede-4caf-af4b-2335667f8cd0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15522025-03-25T01:20:16.866ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e9b0a95-a8b4-48eb-8796-9209c9c47d2a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15532025-03-25T01:20:16.866ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e9b0a95-a8b4-48eb-8796-9209c9c47d2a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15542025-03-25T01:20:16.868ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e9b0a95-a8b4-48eb-8796-9209c9c47d2a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15552025-03-25T01:20:17.886ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a49ff864-c8df-408e-b7e5-928f2a20937b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15562025-03-25T01:20:17.886ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a49ff864-c8df-408e-b7e5-928f2a20937b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15572025-03-25T01:20:17.888ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a49ff864-c8df-408e-b7e5-928f2a20937b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15582025-03-25T01:20:18.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6c47791-b0e9-41ca-87e8-acf2cb177610 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15592025-03-25T01:20:18.910ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6c47791-b0e9-41ca-87e8-acf2cb177610 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15602025-03-25T01:20:18.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2543 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6c47791-b0e9-41ca-87e8-acf2cb177610 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15612025-03-25T01:20:19.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a23883b-930d-4b94-8ab8-af2cc788d102 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15622025-03-25T01:20:19.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a23883b-930d-4b94-8ab8-af2cc788d102 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15632025-03-25T01:20:19.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2305 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a23883b-930d-4b94-8ab8-af2cc788d102 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15642025-03-25T01:20:20.953ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8cb055b-fc56-4c9e-a9c1-6cda7fc914c0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15652025-03-25T01:20:20.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8cb055b-fc56-4c9e-a9c1-6cda7fc914c0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15662025-03-25T01:20:20.955ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1783 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8cb055b-fc56-4c9e-a9c1-6cda7fc914c0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15672025-03-25T01:20:21.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
15682025-03-25T01:20:21.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15692025-03-25T01:20:21.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15702025-03-25T01:20:21.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
15712025-03-25T01:20:21.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15722025-03-25T01:20:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15732025-03-25T01:20:21.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15742025-03-25T01:20:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
15752025-03-25T01:20:21.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15762025-03-25T01:20:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15772025-03-25T01:20:21.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15782025-03-25T01:20:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15792025-03-25T01:20:21.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15802025-03-25T01:20:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
15812025-03-25T01:20:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15822025-03-25T01:20:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15832025-03-25T01:20:21.752ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
15842025-03-25T01:20:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.479497ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
15852025-03-25T01:20:21.765ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
15862025-03-25T01:20:21.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
15872025-03-25T01:20:21.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.514889ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15882025-03-25T01:20:21.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76c3b3d3-1e60-4990-a153-b405eb0ece40 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15892025-03-25T01:20:21.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76c3b3d3-1e60-4990-a153-b405eb0ece40 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15902025-03-25T01:20:21.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2321 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76c3b3d3-1e60-4990-a153-b405eb0ece40 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15912025-03-25T01:20:22.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb50f21e-754a-4393-a0a4-987813518226 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15922025-03-25T01:20:22.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb50f21e-754a-4393-a0a4-987813518226 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15932025-03-25T01:20:22.997ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb50f21e-754a-4393-a0a4-987813518226 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15942025-03-25T01:20:24.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd37d3ae-8ab3-4bf0-9953-5f921ef40e37 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15952025-03-25T01:20:24.015ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd37d3ae-8ab3-4bf0-9953-5f921ef40e37 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15962025-03-25T01:20:24.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd37d3ae-8ab3-4bf0-9953-5f921ef40e37 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15972025-03-25T01:20:25.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b144b6fe-7b14-4210-9536-ac7fd0791210 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15982025-03-25T01:20:25.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b144b6fe-7b14-4210-9536-ac7fd0791210 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
15992025-03-25T01:20:25.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1673 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b144b6fe-7b14-4210-9536-ac7fd0791210 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16002025-03-25T01:20:26.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2881b66-eb35-4ad7-9e67-21fce2fd0cbc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16012025-03-25T01:20:26.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2881b66-eb35-4ad7-9e67-21fce2fd0cbc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16022025-03-25T01:20:26.058ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1973 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2881b66-eb35-4ad7-9e67-21fce2fd0cbc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16032025-03-25T01:20:27.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5bd8771-24d0-4dad-9872-0c83447315df roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16042025-03-25T01:20:27.077ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5bd8771-24d0-4dad-9872-0c83447315df resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16052025-03-25T01:20:27.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5bd8771-24d0-4dad-9872-0c83447315df response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16062025-03-25T01:20:28.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 699e1fef-ef95-49d2-9e56-0c2cda13d41c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16072025-03-25T01:20:28.099ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 699e1fef-ef95-49d2-9e56-0c2cda13d41c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16082025-03-25T01:20:28.101ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2266 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 699e1fef-ef95-49d2-9e56-0c2cda13d41c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16092025-03-25T01:20:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1a5fc86-eaad-47fa-b5a0-9d5a147a30fd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16102025-03-25T01:20:29.122ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1a5fc86-eaad-47fa-b5a0-9d5a147a30fd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16112025-03-25T01:20:29.124ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1a5fc86-eaad-47fa-b5a0-9d5a147a30fd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16122025-03-25T01:20:30.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a822429-0e36-43a5-9969-367e07e35ea8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16132025-03-25T01:20:30.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a822429-0e36-43a5-9969-367e07e35ea8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16142025-03-25T01:20:30.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1883 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a822429-0e36-43a5-9969-367e07e35ea8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16152025-03-25T01:20:31.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42316c76-8dc0-403d-a4bb-7c65cb078ac3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16162025-03-25T01:20:31.166ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42316c76-8dc0-403d-a4bb-7c65cb078ac3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16172025-03-25T01:20:31.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2039 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42316c76-8dc0-403d-a4bb-7c65cb078ac3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
16182025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
16192025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
16202025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16212025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16222025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 3 reason = Timeout
16232025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
16242025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
16252025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
16262025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16272025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16282025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
16292025-03-25T01:20:31.732ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
16302025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 26.23\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
16312025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
16322025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
16332025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16342025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16352025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Timeout
16362025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
16372025-03-25T01:20:31.732ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
16382025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
16392025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
16402025-03-25T01:20:31.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16412025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Timeout
16422025-03-25T01:20:31.733ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16432025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 11.801\u{b5}s iteration = 3 status = {"error":"no config"}
16442025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
16452025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Timeout
16462025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Timeout
16472025-03-25T01:20:31.733ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
16482025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16492025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.43\u{b5}s iteration = 3 status = {"error":"no config"}
16502025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16512025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Timeout
16522025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Timeout
16532025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16542025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16552025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16562025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
16572025-03-25T01:20:31.733ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:10:31.732441452 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
16582025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
16592025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
16602025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Timeout
16612025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16622025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
16632025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
16642025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16652025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
16662025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
16672025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
16682025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
16692025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
16702025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
16712025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 3 reason = Timeout
16722025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
16732025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
16742025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
16752025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
16762025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
16772025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
16782025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
16792025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
16802025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
16812025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
16822025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
16832025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16842025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16852025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16862025-03-25T01:20:31.733ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16872025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
16882025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16892025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16902025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16912025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
16922025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16932025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16942025-03-25T01:20:31.733ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 451730671 } })
16952025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16962025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16972025-03-25T01:20:31.733ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 451887924 } })
16982025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16992025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17002025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
17012025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17022025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
17032025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17042025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17052025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17062025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
17072025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
17082025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17092025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
17102025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.434001ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
17112025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17122025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
17132025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.38561ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
17142025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
17152025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
17162025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
17172025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
17182025-03-25T01:20:31.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17192025-03-25T01:20:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17202025-03-25T01:20:31.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17212025-03-25T01:20:31.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17222025-03-25T01:20:31.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 454660233 } })
17232025-03-25T01:20:31.736ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
17242025-03-25T01:20:31.736ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17252025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.576096ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
17262025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17272025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17282025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17292025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17302025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17312025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17322025-03-25T01:20:31.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17332025-03-25T01:20:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
17342025-03-25T01:20:31.738ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
17352025-03-25T01:20:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
17362025-03-25T01:20:31.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 457801468 } })
17372025-03-25T01:20:31.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17382025-03-25T01:20:31.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
17392025-03-25T01:20:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17402025-03-25T01:20:31.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17412025-03-25T01:20:31.740ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17422025-03-25T01:20:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17432025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17442025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17452025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17462025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17472025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17482025-03-25T01:20:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17492025-03-25T01:20:31.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17502025-03-25T01:20:31.743ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17512025-03-25T01:20:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17522025-03-25T01:20:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17532025-03-25T01:20:31.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
17542025-03-25T01:20:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
17552025-03-25T01:20:31.745ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
17562025-03-25T01:20:31.745ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
17572025-03-25T01:20:31.745ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 12.535919ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
17582025-03-25T01:20:31.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17592025-03-25T01:20:31.745ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17602025-03-25T01:20:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17612025-03-25T01:20:31.746ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.845148ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
17622025-03-25T01:20:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17632025-03-25T01:20:31.747ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17642025-03-25T01:20:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17652025-03-25T01:20:31.750ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:10:31.732441452 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
17662025-03-25T01:20:31.750ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 18.17469ms iteration = 2 status = {"expiration":"2025-03-25T01:10:31.732441452Z","pruned":[]}
17672025-03-25T01:20:31.752ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17682025-03-25T01:20:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17692025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17702025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17712025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17722025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17732025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17742025-03-25T01:20:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17752025-03-25T01:20:31.755ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17762025-03-25T01:20:31.756ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17772025-03-25T01:20:31.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17782025-03-25T01:20:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17792025-03-25T01:20:31.757ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17802025-03-25T01:20:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17812025-03-25T01:20:31.760ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17822025-03-25T01:20:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
17832025-03-25T01:20:31.764ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
17842025-03-25T01:20:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
17852025-03-25T01:20:31.766ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17862025-03-25T01:20:31.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17872025-03-25T01:20:31.780ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882025-03-25T01:20:31.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17892025-03-25T01:20:31.781ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 499990432 } })
17902025-03-25T01:20:31.781ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
17912025-03-25T01:20:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17922025-03-25T01:20:31.784ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17932025-03-25T01:20:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17942025-03-25T01:20:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
17952025-03-25T01:20:31.786ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17962025-03-25T01:20:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17972025-03-25T01:20:31.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
17982025-03-25T01:20:31.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
17992025-03-25T01:20:31.807ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18002025-03-25T01:20:31.810ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18012025-03-25T01:20:31.810ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18022025-03-25T01:20:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18032025-03-25T01:20:31.814ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18042025-03-25T01:20:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
18052025-03-25T01:20:31.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18062025-03-25T01:20:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18072025-03-25T01:20:31.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18082025-03-25T01:20:31.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 89.767935ms iteration = 3 status = {"errors":[],"finish_invoked_ok":[]}
18092025-03-25T01:20:31.822ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
18102025-03-25T01:20:31.822ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18112025-03-25T01:20:31.823ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0638890b-edb2-439a-acad-7613b9f46db9", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
18122025-03-25T01:20:31.823ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18132025-03-25T01:20:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18142025-03-25T01:20:31.825ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
18152025-03-25T01:20:31.825ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
18162025-03-25T01:20:31.825ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 92.649906ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
18172025-03-25T01:20:31.825ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18182025-03-25T01:20:31.825ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 93.00097ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
18192025-03-25T01:20:31.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
18202025-03-25T01:20:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
18212025-03-25T01:20:31.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18222025-03-25T01:20:31.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18232025-03-25T01:20:31.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18242025-03-25T01:20:31.829ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18252025-03-25T01:20:31.830ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
18262025-03-25T01:20:31.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18272025-03-25T01:20:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18282025-03-25T01:20:31.830ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
18292025-03-25T01:20:31.830ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 98.262786ms iteration = 3 status = {"errors":[],"requests_created_ok":[]}
18302025-03-25T01:20:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
18312025-03-25T01:20:31.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18322025-03-25T01:20:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18332025-03-25T01:20:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
18342025-03-25T01:20:31.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
18352025-03-25T01:20:31.837ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 105.209216ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18362025-03-25T01:20:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
18372025-03-25T01:20:31.839ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18382025-03-25T01:20:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18392025-03-25T01:20:31.840ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
18402025-03-25T01:20:31.841ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18412025-03-25T01:20:31.841ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18422025-03-25T01:20:31.841ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "347e7e80-c3e8-43ce-b8bc-5f75a1ed4223", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
18432025-03-25T01:20:31.841ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18442025-03-25T01:20:31.842ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18452025-03-25T01:20:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
18462025-03-25T01:20:31.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18472025-03-25T01:20:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18482025-03-25T01:20:31.853ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
18492025-03-25T01:20:31.853ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
18502025-03-25T01:20:31.853ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
18512025-03-25T01:20:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
18522025-03-25T01:20:31.853ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
18532025-03-25T01:20:31.853ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 121.409678ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
18542025-03-25T01:20:31.854ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18552025-03-25T01:20:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18562025-03-25T01:20:31.872ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 140.320428ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
18572025-03-25T01:20:31.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.156042ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
18582025-03-25T01:20:31.879ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18592025-03-25T01:20:31.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18602025-03-25T01:20:31.880ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
18612025-03-25T01:20:31.880ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
18622025-03-25T01:20:31.880ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
18632025-03-25T01:20:31.880ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18642025-03-25T01:20:31.881ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18652025-03-25T01:20:31.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18662025-03-25T01:20:31.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18672025-03-25T01:20:31.883ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18682025-03-25T01:20:31.883ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18692025-03-25T01:20:31.884ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
18702025-03-25T01:20:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
18712025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
18722025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
18732025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
18742025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
18752025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18762025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18772025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
18782025-03-25T01:20:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18792025-03-25T01:20:31.887ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
18802025-03-25T01:20:31.887ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 154.896657ms iteration = 3 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
18812025-03-25T01:20:31.887ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18822025-03-25T01:20:31.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18832025-03-25T01:20:31.889ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18842025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
18852025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
18862025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
18872025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
18882025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
18892025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
18902025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
18912025-03-25T01:20:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
18922025-03-25T01:20:31.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 160.458526ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
18932025-03-25T01:20:31.893ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18942025-03-25T01:20:31.895ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18952025-03-25T01:20:31.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18962025-03-25T01:20:31.896ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
18972025-03-25T01:20:31.896ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 163.884825ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
18982025-03-25T01:20:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
18992025-03-25T01:20:31.897ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19002025-03-25T01:20:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19012025-03-25T01:20:31.899ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
19022025-03-25T01:20:31.899ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
19032025-03-25T01:20:31.899ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 166.720936ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
19042025-03-25T01:20:31.904ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19052025-03-25T01:20:31.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19062025-03-25T01:20:31.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
19072025-03-25T01:20:31.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
19082025-03-25T01:20:31.922ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 935, tv_nsec: 641055831 } })
19092025-03-25T01:20:31.922ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1077
19102025-03-25T01:20:31.928ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
19112025-03-25T01:20:31.928ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
19122025-03-25T01:20:31.928ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19132025-03-25T01:20:31.929ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19142025-03-25T01:20:31.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19152025-03-25T01:20:31.932ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19162025-03-25T01:20:31.937ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
19172025-03-25T01:20:31.937ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
19182025-03-25T01:20:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
19192025-03-25T01:20:31.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
19202025-03-25T01:20:31.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
19212025-03-25T01:20:31.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
19222025-03-25T01:20:31.940ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
19232025-03-25T01:20:31.940ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
19242025-03-25T01:20:31.940ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19252025-03-25T01:20:31.940ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19262025-03-25T01:20:31.942ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19272025-03-25T01:20:31.942ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
19282025-03-25T01:20:31.942ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
19292025-03-25T01:20:31.942ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
19302025-03-25T01:20:31.942ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 210.114347ms iteration = 2 status = {"generation":1}
19312025-03-25T01:20:31.942ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Dependency
19322025-03-25T01:20:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
19332025-03-25T01:20:31.945ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
19342025-03-25T01:20:31.945ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.071769ms iteration = 5 status = {"physical_disks_added":0}
19352025-03-25T01:20:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
19362025-03-25T01:20:31.971ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
19372025-03-25T01:20:31.971ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
19382025-03-25T01:20:31.971ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 238.508053ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
19392025-03-25T01:20:31.971ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "36881679-5fa0-4006-b740-329a60173714", "content-length": "1", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
19402025-03-25T01:20:31.973ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
19412025-03-25T01:20:31.973ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
19422025-03-25T01:20:31.993ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
19432025-03-25T01:20:31.993ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
19442025-03-25T01:20:31.993ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e4ee949-ed57-4d87-b9b0-3cc2b39fbbf5", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
19452025-03-25T01:20:31.993ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
19462025-03-25T01:20:31.994ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
19472025-03-25T01:20:31.999ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
19482025-03-25T01:20:31.999ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 266.594005ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
19492025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = / versions = all
19502025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /access versions = all
19512025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /assets/{path} versions = all
19522025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/auth versions = all
19532025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/confirm versions = all
19542025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/success versions = all
19552025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /device/token versions = all
19562025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /device/verify versions = all
19572025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes versions = all
19582025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/probes versions = all
19592025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
19602025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/probes/{probe} versions = all
19612025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles versions = all
19622025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /experimental/v1/system/support-bundles versions = all
19632025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19642025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
19652025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19662025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
19672025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19682025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
19692025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
19702025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /images versions = all
19712025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login versions = all
19722025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/local versions = all
19732025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
19742025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
19752025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
19762025-03-25T01:20:32.015ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /lookup/{path} versions = all
19772025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects/{path} versions = all
19782025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /projects-new versions = all
19792025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /settings/{path} versions = all
19802025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /system/{path} versions = all
19812025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /utilization versions = all
19822025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups versions = all
19832025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/affinity-groups versions = all
19842025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
19852025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
19862025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
19872025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
19882025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19892025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19902025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
19912025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups versions = all
19922025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/anti-affinity-groups versions = all
19932025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19942025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19952025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
19962025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
19972025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
19982025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
19992025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
20002025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates versions = all
20012025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/certificates versions = all
20022025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/certificates/{certificate} versions = all
20032025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/certificates/{certificate} versions = all
20042025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks versions = all
20052025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks versions = all
20062025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/disks/{disk} versions = all
20072025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk} versions = all
20082025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
20092025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
20102025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
20112025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/disks/{disk}/finalize versions = all
20122025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
20132025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips versions = all
20142025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips versions = all
20152025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
20162025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
20172025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
20182025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
20192025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
20202025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups versions = all
20212025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/groups/{group_id} versions = all
20222025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images versions = all
20232025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images versions = all
20242025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/images/{image} versions = all
20252025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/images/{image} versions = all
20262025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/demote versions = all
20272025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/images/{image}/promote versions = all
20282025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances versions = all
20292025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances versions = all
20302025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance} versions = all
20312025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance} versions = all
20322025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/instances/{instance} versions = all
20332025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/disks versions = all
20342025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
20352025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
20362025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
20372025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20382025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20392025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/reboot versions = all
20402025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
20412025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
20422025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
20432025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/start versions = all
20442025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/instances/{instance}/stop versions = all
20452025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
20462025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
20472025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
20482025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
20492025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
20502025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
20512025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways versions = all
20522025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/internet-gateways versions = all
20532025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
20542025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
20552025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools versions = all
20562025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ip-pools/{pool} versions = all
20572025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/login/{silo_name}/local versions = all
20582025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/logout versions = all
20592025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me versions = all
20602025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/groups versions = all
20612025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys versions = all
20622025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/me/ssh-keys versions = all
20632025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20642025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20652025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/metrics/{metric_name} versions = all
20662025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces versions = all
20672025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/network-interfaces versions = all
20682025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
20692025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/network-interfaces/{interface} versions = all
20702025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
20712025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/ping versions = all
20722025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/policy versions = all
20732025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/policy versions = all
20742025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects versions = all
20752025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/projects versions = all
20762025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/projects/{project} versions = all
20772025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project} versions = all
20782025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project} versions = all
20792025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/projects/{project}/policy versions = all
20802025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/projects/{project}/policy versions = all
20812025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots versions = all
20822025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/snapshots versions = all
20832025-03-25T01:20:32.016ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
20842025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/snapshots/{snapshot} versions = all
20852025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks versions = all
20862025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
20872025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
20882025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks versions = all
20892025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
20902025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds versions = all
20912025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/sleds versions = all
20922025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
20932025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
20942025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
20952025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
20962025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
20972025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port versions = all
20982025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
20992025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
21002025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
21012025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
21022025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
21032025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches versions = all
21042025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
21052025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers versions = all
21062025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users versions = all
21072025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
21082025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
21092025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/identity-providers/saml versions = all
21102025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
21112025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools versions = all
21122025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools versions = all
21132025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
21142025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
21152025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
21162025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
21172025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
21182025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
21192025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
21202025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
21212025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21222025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21232025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
21242025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service versions = all
21252025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
21262025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
21272025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
21282025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
21292025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot versions = all
21302025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/address-lot versions = all
21312025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
21322025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
21332025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/allow-list versions = all
21342025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/allow-list versions = all
21352025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-disable versions = all
21362025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bfd-enable versions = all
21372025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bfd-status versions = all
21382025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp versions = all
21392025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp versions = all
21402025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/bgp versions = all
21412025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
21422025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
21432025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
21442025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
21452025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-exported versions = all
21462025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
21472025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
21482025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/bgp-status versions = all
21492025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/loopback-address versions = all
21502025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/loopback-address versions = all
21512025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
21522025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
21532025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
21542025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
21552025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
21562025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/policy versions = all
21572025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/policy versions = all
21582025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles versions = all
21592025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/roles/{role_name} versions = all
21602025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silo-quotas versions = all
21612025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos versions = all
21622025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/silos versions = all
21632025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21642025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo} versions = all
21652025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21662025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21672025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21682025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
21692025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
21702025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/system/timeseries/query versions = all
21712025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/timeseries/schemas versions = all
21722025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/repository versions = all
21732025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
21742025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/update/target-release versions = all
21752025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/system/update/target-release versions = all
21762025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users versions = all
21772025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users/{user_id} versions = all
21782025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin versions = all
21792025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/users-builtin/{user} versions = all
21802025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos versions = all
21812025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
21822025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/timeseries/query versions = all
21832025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/users versions = all
21842025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/utilization versions = all
21852025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-firewall-rules versions = all
21862025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-firewall-rules versions = all
21872025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes versions = all
21882025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-router-routes versions = all
21892025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
21902025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
21912025-03-25T01:20:32.017ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
21922025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers versions = all
21932025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-routers versions = all
21942025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
21952025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-routers/{router} versions = all
21962025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-routers/{router} versions = all
21972025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets versions = all
21982025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpc-subnets versions = all
21992025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
22002025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
22012025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
22022025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
22032025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs versions = all
22042025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = POST path = /v1/vpcs versions = all
22052025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
22062025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = GET path = /v1/vpcs/{vpc} versions = all
22072025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.6:443 method = PUT path = /v1/vpcs/{vpc} versions = all
22082025-03-25T01:20:32.018ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = 172.30.2.6:443
22092025-03-25T01:20:32.018ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.6:443
22102025-03-25T01:20:32.024ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 292.611237ms iteration = 3 status = {}
22112025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = / versions = all
22122025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /access versions = all
22132025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /assets/{path} versions = all
22142025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/auth versions = all
22152025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/confirm versions = all
22162025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/success versions = all
22172025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /device/token versions = all
22182025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /device/verify versions = all
22192025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes versions = all
22202025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/probes versions = all
22212025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
22222025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
22232025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles versions = all
22242025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /experimental/v1/system/support-bundles versions = all
22252025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
22262025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle} versions = all
22272025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
22282025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download versions = all
22292025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
22302025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = HEAD path = /experimental/v1/system/support-bundles/{support_bundle}/download/{file} versions = all
22312025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /experimental/v1/system/support-bundles/{support_bundle}/index versions = all
22322025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /images versions = all
22332025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login versions = all
22342025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/local versions = all
22352025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
22362025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
22372025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
22382025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /lookup/{path} versions = all
22392025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects/{path} versions = all
22402025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /projects-new versions = all
22412025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /settings/{path} versions = all
22422025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /system/{path} versions = all
22432025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /utilization versions = all
22442025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups versions = all
22452025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/affinity-groups versions = all
22462025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group} versions = all
22472025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group} versions = all
22482025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/affinity-groups/{affinity_group} versions = all
22492025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members versions = all
22502025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
22512025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
22522025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/affinity-groups/{affinity_group}/members/instance/{instance} versions = all
22532025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups versions = all
22542025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/anti-affinity-groups versions = all
22552025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
22562025-03-25T01:20:32.027ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
22572025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/anti-affinity-groups/{anti_affinity_group} versions = all
22582025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members versions = all
22592025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22602025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22612025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/anti-affinity-groups/{anti_affinity_group}/members/instance/{instance} versions = all
22622025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates versions = all
22632025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/certificates versions = all
22642025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
22652025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/certificates/{certificate} versions = all
22662025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks versions = all
22672025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks versions = all
22682025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/disks/{disk} versions = all
22692025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk} versions = all
22702025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
22712025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
22722025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
22732025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
22742025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
22752025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips versions = all
22762025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips versions = all
22772025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
22782025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
22792025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
22802025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
22812025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
22822025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups versions = all
22832025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/groups/{group_id} versions = all
22842025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images versions = all
22852025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images versions = all
22862025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/images/{image} versions = all
22872025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/images/{image} versions = all
22882025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/demote versions = all
22892025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/images/{image}/promote versions = all
22902025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances versions = all
22912025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances versions = all
22922025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance} versions = all
22932025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance} versions = all
22942025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/instances/{instance} versions = all
22952025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22962025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22972025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22982025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22992025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23002025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
23012025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
23022025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
23032025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
23042025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
23052025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/start versions = all
23062025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
23072025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
23082025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
23092025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
23102025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
23112025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
23122025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
23132025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways versions = all
23142025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/internet-gateways versions = all
23152025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
23162025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
23172025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools versions = all
23182025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
23192025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
23202025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/logout versions = all
23212025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me versions = all
23222025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/groups versions = all
23232025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys versions = all
23242025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/me/ssh-keys versions = all
23252025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
23262025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
23272025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
23282025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces versions = all
23292025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/network-interfaces versions = all
23302025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
23312025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
23322025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
23332025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/ping versions = all
23342025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/policy versions = all
23352025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/policy versions = all
23362025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects versions = all
23372025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/projects versions = all
23382025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/projects/{project} versions = all
23392025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project} versions = all
23402025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project} versions = all
23412025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/projects/{project}/policy versions = all
23422025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
23432025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots versions = all
23442025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/snapshots versions = all
23452025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
23462025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
23472025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks versions = all
23482025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
23492025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/rack-switch-port/{rack_id}/{switch_location}/{port}/lldp/neighbors versions = all
23502025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks versions = all
23512025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
23522025-03-25T01:20:32.028ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds versions = all
23532025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/sleds versions = all
23542025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
23552025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
23562025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
23572025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
23582025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
23592025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
23602025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
23612025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/lldp/config versions = all
23622025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
23632025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
23642025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
23652025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches versions = all
23662025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
23672025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers versions = all
23682025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
23692025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
23702025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
23712025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
23722025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
23732025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools versions = all
23742025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools versions = all
23752025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
23762025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
23772025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
23782025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
23792025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
23802025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
23812025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
23822025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
23832025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23842025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23852025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
23862025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service versions = all
23872025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
23882025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
23892025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
23902025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
23912025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot versions = all
23922025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/address-lot versions = all
23932025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
23942025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
23952025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/allow-list versions = all
23962025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
23972025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23982025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23992025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
24002025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
24012025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp versions = all
24022025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/bgp versions = all
24032025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
24042025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
24052025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
24062025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
24072025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
24082025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
24092025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
24102025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
24112025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
24122025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
24132025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
24142025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
24152025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
24162025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
24172025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
24182025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/policy versions = all
24192025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/policy versions = all
24202025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles versions = all
24212025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
24222025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silo-quotas versions = all
24232025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos versions = all
24242025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/silos versions = all
24252025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
24262025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo} versions = all
24272025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
24282025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
24292025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
24302025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
24312025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
24322025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/system/timeseries/query versions = all
24332025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
24342025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/repository versions = all
24352025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
24362025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/update/target-release versions = all
24372025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/system/update/target-release versions = all
24382025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users versions = all
24392025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users/{user_id} versions = all
24402025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin versions = all
24412025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
24422025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos versions = all
24432025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
24442025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/timeseries/query versions = all
24452025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/users versions = all
24462025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/utilization versions = all
24472025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
24482025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
24492025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes versions = all
24502025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-router-routes versions = all
24512025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
24522025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
24532025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
24542025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers versions = all
24552025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-routers versions = all
24562025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
24572025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
24582025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
24592025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets versions = all
24602025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpc-subnets versions = all
24612025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
24622025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
24632025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
24642025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
24652025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs versions = all
24662025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = POST path = /v1/vpcs versions = all
24672025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
24682025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
24692025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::b]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
24702025-03-25T01:20:32.029ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:12228
24712025-03-25T01:20:32.029ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:12228
24722025-03-25T01:20:32.030ZDEBGnexus (nexus-producer-server): registered DTrace probes
24732025-03-25T01:20:32.034ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::b]:37373 method = GET path = /{producer_id} versions = all
24742025-03-25T01:20:32.034ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:328 local_addr = [fd00:1122:3344:101::b]:37373
24752025-03-25T01:20:32.034ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::b]:37373
24762025-03-25T01:20:32.034ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::b]:37373
24772025-03-25T01:20:32.034ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::b]:12221
24782025-03-25T01:20:32.034ZDEBGnexus (nexus-producer-server): starting producer registration task
24792025-03-25T01:20:32.035ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::b]:37373 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
24802025-03-25T01:20:32.035ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24812025-03-25T01:20:32.035ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
24822025-03-25T01:20:32.139ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
24832025-03-25T01:20:32.140ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
24842025-03-25T01:20:32.140ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c5f38ef-0ca5-4820-8ea0-379d38acd0bd", "content-length": "372", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
24852025-03-25T01:20:32.140ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
24862025-03-25T01:20:32.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
24872025-03-25T01:20:32.142ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
24882025-03-25T01:20:32.142ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
24892025-03-25T01:20:32.142ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
24902025-03-25T01:20:32.142ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 410.020317ms iteration = 2 status = {"generation":2}
24912025-03-25T01:20:32.142ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Dependency
24922025-03-25T01:20:32.143ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 411.054402ms iteration = 3 status = null
24932025-03-25T01:20:32.150ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
24942025-03-25T01:20:32.150ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ece2e81-da6c-4578-b0e4-81a50dfa7d27", "content-length": "691", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
24952025-03-25T01:20:32.150ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
24962025-03-25T01:20:32.150ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
24972025-03-25T01:20:32.150ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
24982025-03-25T01:20:32.152ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 420.145352ms iteration = 3 status = {}
24992025-03-25T01:20:32.161ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
25002025-03-25T01:20:32.161ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
25012025-03-25T01:20:32.161ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9c939d0d-ef72-42e4-a146-3dc95be9e808", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25022025-03-25T01:20:32.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25032025-03-25T01:20:32.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25042025-03-25T01:20:32.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25052025-03-25T01:20:32.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25062025-03-25T01:20:32.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
25072025-03-25T01:20:32.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
25082025-03-25T01:20:32.172ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
25092025-03-25T01:20:32.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
25102025-03-25T01:20:32.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "361cc7b6-ace4-4f8a-bde8-5f686b55b41f", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25112025-03-25T01:20:32.173ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 441.114872ms iteration = 3 status = {}
25122025-03-25T01:20:32.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2b87f6c3-bdd5-425c-9d4e-a12008fcd725 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25132025-03-25T01:20:32.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2b87f6c3-bdd5-425c-9d4e-a12008fcd725 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25142025-03-25T01:20:32.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2107 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2b87f6c3-bdd5-425c-9d4e-a12008fcd725 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25152025-03-25T01:20:32.204ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
25162025-03-25T01:20:32.205ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:34939
25172025-03-25T01:20:32.205ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34939 req_id = f1b06482-48a0-4f8b-b23c-fef21580ba50 roles = RoleSet { roles: {} } uri = /metrics/producers
25182025-03-25T01:20:32.205ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34939 req_id = f1b06482-48a0-4f8b-b23c-fef21580ba50 resource = Database result = Ok(()) uri = /metrics/producers
25192025-03-25T01:20:32.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
25202025-03-25T01:20:32.210ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
25212025-03-25T01:20:32.211ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "344c7056-ee78-46e3-867d-0572984b0dce", "content-length": "26", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25222025-03-25T01:20:32.211ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
25232025-03-25T01:20:32.212ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
25242025-03-25T01:20:32.226ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
25252025-03-25T01:20:32.251ZINFOnexus: assigned collector to new producer collector_id = a9f260fd-b911-4f87-b07b-84934591a3eb file = nexus/src/app/oximeter.rs:76 producer_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
25262025-03-25T01:20:32.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 46364 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:34939 req_id = f1b06482-48a0-4f8b-b23c-fef21580ba50 response_code = 201 uri = /metrics/producers
25272025-03-25T01:20:32.251ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "f1b06482-48a0-4f8b-b23c-fef21580ba50", "content-length": "41", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} })
25282025-03-25T01:20:32.253ZDEBGnexus (producer-registration-task): registered with nexus successfully
25292025-03-25T01:20:32.253ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
25302025-03-25T01:20:32.269ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
25312025-03-25T01:20:32.329ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
25322025-03-25T01:20:32.329ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "f804390f-25cb-43cc-a34e-743f731da2f2", "content-length": "4", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25332025-03-25T01:20:32.331ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 599.775312ms iteration = 3 status = 6
25342025-03-25T01:20:32.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
25352025-03-25T01:20:32.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
25362025-03-25T01:20:32.377ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c655a968-9cb0-49cd-a2a9-e40422c2dcd7", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25372025-03-25T01:20:32.377ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25382025-03-25T01:20:32.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "00bee491-c6d2-4f31-8d21-3d100e1d98a5", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25392025-03-25T01:20:32.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25402025-03-25T01:20:32.381ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
25412025-03-25T01:20:32.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 238.749886ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
25422025-03-25T01:20:32.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25432025-03-25T01:20:32.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25442025-03-25T01:20:32.388ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
25452025-03-25T01:20:32.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25462025-03-25T01:20:32.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25472025-03-25T01:20:32.400ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
25482025-03-25T01:20:32.400ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "05e5f862-ec3f-4fba-904c-c840528744ac", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25492025-03-25T01:20:32.400ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25502025-03-25T01:20:32.402ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "caf1521a-8d1d-42c5-a847-2422b1d8844e", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25512025-03-25T01:20:32.402ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25522025-03-25T01:20:32.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "9f14c743-e9c7-41d1-a9d4-3d26eb1b15e2", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25532025-03-25T01:20:32.404ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25542025-03-25T01:20:32.404ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
25552025-03-25T01:20:32.405ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f7033b1-9e64-46e0-a55d-5351bd174f1d", "content-length": "134", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25562025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
25572025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
25582025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
25592025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
25602025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25612025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25622025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25632025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25642025-03-25T01:20:32.405ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
25652025-03-25T01:20:32.405ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 463.397611ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
25662025-03-25T01:20:32.406ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
25672025-03-25T01:20:32.406ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
25682025-03-25T01:20:32.406ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
25692025-03-25T01:20:32.406ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25702025-03-25T01:20:32.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25712025-03-25T01:20:32.408ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
25722025-03-25T01:20:32.408ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "00d7dd98-d270-4bf3-87a6-2ded70df88ed", "content-length": "2", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25732025-03-25T01:20:32.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
25742025-03-25T01:20:32.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b067876-ca05-4f1f-bbe4-09d73fd62ff4", "content-length": "51", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25752025-03-25T01:20:32.409ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
25762025-03-25T01:20:32.409ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
25772025-03-25T01:20:32.548ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf2e2864-c17e-48e7-adc9-58546f0a9a25", "date": "Tue, 25 Mar 2025 01:20:31 GMT"} })
25782025-03-25T01:20:32.548ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
25792025-03-25T01:20:32.548ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
25802025-03-25T01:20:32.549ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "14e5bec1-0884-4bb6-88a2-9d226b9e9076", "content-length": "682", "date": "Tue, 25 Mar 2025 01:20:32 GMT"} })
25812025-03-25T01:20:32.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25822025-03-25T01:20:32.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25832025-03-25T01:20:32.558ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25842025-03-25T01:20:32.559ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25852025-03-25T01:20:32.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25862025-03-25T01:20:32.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25872025-03-25T01:20:32.565ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
25882025-03-25T01:20:32.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
25892025-03-25T01:20:32.580ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 848.011574ms iteration = 3 status = {}
25902025-03-25T01:20:33.211ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f9d62bb-fed6-432e-8a63-ece578b2a11f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25912025-03-25T01:20:33.211ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f9d62bb-fed6-432e-8a63-ece578b2a11f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25922025-03-25T01:20:33.213ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f9d62bb-fed6-432e-8a63-ece578b2a11f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25932025-03-25T01:20:34.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8a6cf2f-4f1a-4ba2-a82d-37a284898545 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25942025-03-25T01:20:34.233ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8a6cf2f-4f1a-4ba2-a82d-37a284898545 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25952025-03-25T01:20:34.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1773 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8a6cf2f-4f1a-4ba2-a82d-37a284898545 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25962025-03-25T01:20:35.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8247a16-f935-450f-a046-82fcb710ab95 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25972025-03-25T01:20:35.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8247a16-f935-450f-a046-82fcb710ab95 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25982025-03-25T01:20:35.257ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2411 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8247a16-f935-450f-a046-82fcb710ab95 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
25992025-03-25T01:20:36.275ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c984c47d-3c76-43f1-a091-6a4bf62ff4ab roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26002025-03-25T01:20:36.276ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c984c47d-3c76-43f1-a091-6a4bf62ff4ab resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26012025-03-25T01:20:36.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c984c47d-3c76-43f1-a091-6a4bf62ff4ab response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26022025-03-25T01:20:37.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1951215-ef38-4171-b793-5387d2caef93 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26032025-03-25T01:20:37.298ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1951215-ef38-4171-b793-5387d2caef93 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26042025-03-25T01:20:37.300ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1947 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1951215-ef38-4171-b793-5387d2caef93 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26052025-03-25T01:20:38.320ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ab492d8b-a8c2-42b4-b690-f257b8d4ab75 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26062025-03-25T01:20:38.320ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ab492d8b-a8c2-42b4-b690-f257b8d4ab75 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26072025-03-25T01:20:38.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2307 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ab492d8b-a8c2-42b4-b690-f257b8d4ab75 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26082025-03-25T01:20:39.343ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6d258545-6315-4e14-b453-2df9bc6237ee roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26092025-03-25T01:20:39.343ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6d258545-6315-4e14-b453-2df9bc6237ee resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26102025-03-25T01:20:39.345ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2398 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6d258545-6315-4e14-b453-2df9bc6237ee response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26112025-03-25T01:20:40.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 474a9d5b-e831-42e5-9726-3a3e67c8ce5f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26122025-03-25T01:20:40.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 474a9d5b-e831-42e5-9726-3a3e67c8ce5f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26132025-03-25T01:20:40.367ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 474a9d5b-e831-42e5-9726-3a3e67c8ce5f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26142025-03-25T01:20:41.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8408e6a4-4e66-436b-87f7-528dbe230f8a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26152025-03-25T01:20:41.387ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8408e6a4-4e66-436b-87f7-528dbe230f8a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26162025-03-25T01:20:41.389ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8408e6a4-4e66-436b-87f7-528dbe230f8a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26172025-03-25T01:20:41.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
26182025-03-25T01:20:41.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26192025-03-25T01:20:41.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26202025-03-25T01:20:41.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26212025-03-25T01:20:41.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
26222025-03-25T01:20:41.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26232025-03-25T01:20:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26242025-03-25T01:20:41.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26252025-03-25T01:20:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26262025-03-25T01:20:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26272025-03-25T01:20:41.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26282025-03-25T01:20:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26292025-03-25T01:20:41.736ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.432689ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26302025-03-25T01:20:41.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26312025-03-25T01:20:41.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26322025-03-25T01:20:41.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26332025-03-25T01:20:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
26342025-03-25T01:20:41.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26352025-03-25T01:20:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26362025-03-25T01:20:41.753ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
26372025-03-25T01:20:41.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.417106ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
26382025-03-25T01:20:42.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c9ef0b03-363d-4b78-b563-868f7ccc37de roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26392025-03-25T01:20:42.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c9ef0b03-363d-4b78-b563-868f7ccc37de resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26402025-03-25T01:20:42.411ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c9ef0b03-363d-4b78-b563-868f7ccc37de response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26412025-03-25T01:20:43.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6e1317a-5bd6-4d3d-9e9f-7325b1db4d83 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26422025-03-25T01:20:43.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6e1317a-5bd6-4d3d-9e9f-7325b1db4d83 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26432025-03-25T01:20:43.434ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6e1317a-5bd6-4d3d-9e9f-7325b1db4d83 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26442025-03-25T01:20:44.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d4604caf-4f0a-4003-a56a-af59740a3550 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26452025-03-25T01:20:44.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d4604caf-4f0a-4003-a56a-af59740a3550 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26462025-03-25T01:20:44.456ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d4604caf-4f0a-4003-a56a-af59740a3550 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26472025-03-25T01:20:45.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d72b45-73ea-411d-a697-f885c10bd1c5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26482025-03-25T01:20:45.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d72b45-73ea-411d-a697-f885c10bd1c5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26492025-03-25T01:20:45.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d72b45-73ea-411d-a697-f885c10bd1c5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26502025-03-25T01:20:46.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d241f1d6-dba7-4049-be66-1c323303267d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26512025-03-25T01:20:46.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d241f1d6-dba7-4049-be66-1c323303267d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26522025-03-25T01:20:46.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d241f1d6-dba7-4049-be66-1c323303267d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26532025-03-25T01:20:47.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f805e8b-83bd-4cf8-91fb-c755b0735907 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26542025-03-25T01:20:47.523ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f805e8b-83bd-4cf8-91fb-c755b0735907 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26552025-03-25T01:20:47.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1898 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f805e8b-83bd-4cf8-91fb-c755b0735907 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26562025-03-25T01:20:48.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bc4fdd9c-dc3c-49c4-8f3a-70f3b18b174d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26572025-03-25T01:20:48.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bc4fdd9c-dc3c-49c4-8f3a-70f3b18b174d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26582025-03-25T01:20:48.547ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2077 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bc4fdd9c-dc3c-49c4-8f3a-70f3b18b174d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26592025-03-25T01:20:49.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9dde810-a339-4148-a892-a1b8a6a9b6f3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26602025-03-25T01:20:49.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9dde810-a339-4148-a892-a1b8a6a9b6f3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26612025-03-25T01:20:49.569ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9dde810-a339-4148-a892-a1b8a6a9b6f3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26622025-03-25T01:20:50.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cc7c94ad-eb41-40ec-9b62-ca86d91f69e7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26632025-03-25T01:20:50.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cc7c94ad-eb41-40ec-9b62-ca86d91f69e7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26642025-03-25T01:20:50.592ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cc7c94ad-eb41-40ec-9b62-ca86d91f69e7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26652025-03-25T01:20:51.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db542046-4482-47e7-8c72-23f3fc33b381 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26662025-03-25T01:20:51.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db542046-4482-47e7-8c72-23f3fc33b381 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26672025-03-25T01:20:51.615ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db542046-4482-47e7-8c72-23f3fc33b381 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26682025-03-25T01:20:51.731ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
26692025-03-25T01:20:51.731ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26702025-03-25T01:20:51.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26712025-03-25T01:20:51.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
26722025-03-25T01:20:51.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26732025-03-25T01:20:51.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26742025-03-25T01:20:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26752025-03-25T01:20:51.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
26762025-03-25T01:20:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
26772025-03-25T01:20:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
26782025-03-25T01:20:51.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26792025-03-25T01:20:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26802025-03-25T01:20:51.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.41854ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
26812025-03-25T01:20:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26822025-03-25T01:20:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26832025-03-25T01:20:51.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
26842025-03-25T01:20:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
26852025-03-25T01:20:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
26862025-03-25T01:20:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
26872025-03-25T01:20:51.751ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
26882025-03-25T01:20:51.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.911144ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
26892025-03-25T01:20:52.635ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f4b0acc-9587-4559-8940-5d00f7612c60 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26902025-03-25T01:20:52.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f4b0acc-9587-4559-8940-5d00f7612c60 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26912025-03-25T01:20:52.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4622 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f4b0acc-9587-4559-8940-5d00f7612c60 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26922025-03-25T01:20:53.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db3a1cf1-d253-4e7c-a75b-87304899942e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26932025-03-25T01:20:53.661ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db3a1cf1-d253-4e7c-a75b-87304899942e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26942025-03-25T01:20:53.663ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db3a1cf1-d253-4e7c-a75b-87304899942e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26952025-03-25T01:20:54.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e2ee61f-7f93-437a-a07e-5b33edd33daf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26962025-03-25T01:20:54.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e2ee61f-7f93-437a-a07e-5b33edd33daf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26972025-03-25T01:20:54.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2080 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e2ee61f-7f93-437a-a07e-5b33edd33daf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26982025-03-25T01:20:55.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 215bc3eb-741b-42c9-aaee-a62dea60163b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
26992025-03-25T01:20:55.705ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 215bc3eb-741b-42c9-aaee-a62dea60163b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27002025-03-25T01:20:55.707ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 215bc3eb-741b-42c9-aaee-a62dea60163b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27012025-03-25T01:20:55.759ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:37373 remote_addr = [fd00:1122:3344:101::d]:48741
27022025-03-25T01:20:55.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 4210 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 28ba3cc9-666e-4752-a6f7-1a407ed7249b response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
27032025-03-25T01:20:56.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 78c4bbce-9d18-46f5-ad67-404542d83a45 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27042025-03-25T01:20:56.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 78c4bbce-9d18-46f5-ad67-404542d83a45 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27052025-03-25T01:20:56.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2558 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 78c4bbce-9d18-46f5-ad67-404542d83a45 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27062025-03-25T01:20:57.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 201ed988-ba4b-469c-a3b2-598e3153d0cb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27072025-03-25T01:20:57.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 201ed988-ba4b-469c-a3b2-598e3153d0cb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27082025-03-25T01:20:57.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2385 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 201ed988-ba4b-469c-a3b2-598e3153d0cb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27092025-03-25T01:20:58.772ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce35d0a-27d1-4b91-9721-8eda179b7097 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27102025-03-25T01:20:58.772ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce35d0a-27d1-4b91-9721-8eda179b7097 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27112025-03-25T01:20:58.774ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2187 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce35d0a-27d1-4b91-9721-8eda179b7097 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27122025-03-25T01:20:59.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6abf52a9-2c4b-4576-b7d6-a1f87f4e2382 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27132025-03-25T01:20:59.795ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6abf52a9-2c4b-4576-b7d6-a1f87f4e2382 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27142025-03-25T01:20:59.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6abf52a9-2c4b-4576-b7d6-a1f87f4e2382 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27152025-03-25T01:21:00.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be380888-a191-41c5-ad2a-5a765e26deb9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27162025-03-25T01:21:00.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be380888-a191-41c5-ad2a-5a765e26deb9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27172025-03-25T01:21:00.819ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be380888-a191-41c5-ad2a-5a765e26deb9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
27182025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
27192025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
27202025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
27212025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27222025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27232025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
27242025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
27252025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
27262025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
27272025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
27282025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27292025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
27302025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 4 reason = Timeout
27312025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27322025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
27332025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
27342025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
27352025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
27362025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
27372025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27382025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27392025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
27402025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
27412025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
27422025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27432025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27442025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
27452025-03-25T01:21:01.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
27462025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
27472025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
27482025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
27492025-03-25T01:21:01.733ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
27502025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
27512025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
27522025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
27532025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
27542025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
27552025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
27562025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
27572025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
27582025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
27592025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
27602025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 4 reason = Timeout
27612025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
27622025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
27632025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
27642025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
27652025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27662025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27672025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
27682025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
27692025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
27702025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
27712025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
27722025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
27732025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
27742025-03-25T01:21:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
27752025-03-25T01:21:01.734ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.962768ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
27762025-03-25T01:21:01.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27772025-03-25T01:21:01.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27782025-03-25T01:21:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
27792025-03-25T01:21:01.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
27802025-03-25T01:21:01.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 454860856 } })
27812025-03-25T01:21:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
27822025-03-25T01:21:01.736ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
27832025-03-25T01:21:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
27842025-03-25T01:21:01.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
27852025-03-25T01:21:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
27862025-03-25T01:21:01.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27872025-03-25T01:21:01.739ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27882025-03-25T01:21:01.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
27892025-03-25T01:21:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
27902025-03-25T01:21:01.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
27912025-03-25T01:21:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
27922025-03-25T01:21:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
27932025-03-25T01:21:01.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
27942025-03-25T01:21:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
27952025-03-25T01:21:01.742ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
27962025-03-25T01:21:01.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 461125756 } })
27972025-03-25T01:21:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
27982025-03-25T01:21:01.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
27992025-03-25T01:21:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
28002025-03-25T01:21:01.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28012025-03-25T01:21:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28022025-03-25T01:21:01.744ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28032025-03-25T01:21:01.744ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28042025-03-25T01:21:01.744ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28052025-03-25T01:21:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28062025-03-25T01:21:01.746ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28072025-03-25T01:21:01.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28082025-03-25T01:21:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28092025-03-25T01:21:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
28102025-03-25T01:21:01.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
28112025-03-25T01:21:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
28122025-03-25T01:21:01.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.308704ms iteration = 4 status = {"errors":[],"finish_invoked_ok":[]}
28132025-03-25T01:21:01.750ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28142025-03-25T01:21:01.750ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
28152025-03-25T01:21:01.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28162025-03-25T01:21:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28172025-03-25T01:21:01.753ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
28182025-03-25T01:21:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
28192025-03-25T01:21:01.753ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28202025-03-25T01:21:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28212025-03-25T01:21:01.754ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28222025-03-25T01:21:01.754ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 21.040681ms iteration = 4 status = {"errors":[],"requests_created_ok":[]}
28232025-03-25T01:21:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28242025-03-25T01:21:01.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 965, tv_nsec: 473183668 } })
28252025-03-25T01:21:01.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28262025-03-25T01:21:01.755ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 21.917444ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
28272025-03-25T01:21:01.755ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
28282025-03-25T01:21:01.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28292025-03-25T01:21:01.756ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
28302025-03-25T01:21:01.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
28312025-03-25T01:21:01.756ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28322025-03-25T01:21:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28332025-03-25T01:21:01.764ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28342025-03-25T01:21:01.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.78706ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
28352025-03-25T01:21:01.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
28362025-03-25T01:21:01.766ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28372025-03-25T01:21:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28382025-03-25T01:21:01.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28392025-03-25T01:21:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
28402025-03-25T01:21:01.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
28412025-03-25T01:21:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
28422025-03-25T01:21:01.781ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28432025-03-25T01:21:01.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28442025-03-25T01:21:01.783ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28452025-03-25T01:21:01.785ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28462025-03-25T01:21:01.785ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28472025-03-25T01:21:01.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28482025-03-25T01:21:01.792ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
28492025-03-25T01:21:01.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
28502025-03-25T01:21:01.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.404254ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
28512025-03-25T01:21:01.802ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28522025-03-25T01:21:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28532025-03-25T01:21:01.819ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
28542025-03-25T01:21:01.819ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.288315ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
28552025-03-25T01:21:01.819ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28562025-03-25T01:21:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28572025-03-25T01:21:01.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28582025-03-25T01:21:01.824ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
28592025-03-25T01:21:01.824ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
28602025-03-25T01:21:01.824ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
28612025-03-25T01:21:01.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
28622025-03-25T01:21:01.824ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.400938ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
28632025-03-25T01:21:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
28642025-03-25T01:21:01.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
28652025-03-25T01:21:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
28662025-03-25T01:21:01.829ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
28672025-03-25T01:21:01.829ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28682025-03-25T01:21:01.829ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e28b3ba-e5e7-4ac3-9a5d-5d8c0d216d7b", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
28692025-03-25T01:21:01.829ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28702025-03-25T01:21:01.830ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28712025-03-25T01:21:01.833ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 101.271959ms iteration = 6 status = {"physical_disks_added":0}
28722025-03-25T01:21:01.841ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 044b2036-2da5-4873-82bc-794cd213e567 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
28732025-03-25T01:21:01.841ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 044b2036-2da5-4873-82bc-794cd213e567 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
28742025-03-25T01:21:01.857ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
28752025-03-25T01:21:01.857ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28762025-03-25T01:21:01.858ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e14a024-e520-4260-a612-6f0187e16f85", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
28772025-03-25T01:21:01.858ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28782025-03-25T01:21:01.859ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
28792025-03-25T01:21:01.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
28802025-03-25T01:21:01.867ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
28812025-03-25T01:21:01.867ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b890d28-d27e-4002-95e9-bbb9a38e3fbb", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
28822025-03-25T01:21:01.867ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
28832025-03-25T01:21:01.869ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
28842025-03-25T01:21:01.919ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
28852025-03-25T01:21:01.919ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
28862025-03-25T01:21:01.919ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "89e0f0a5-21f6-49e6-a35f-8b7c78b80378", "content-length": "372", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
28872025-03-25T01:21:01.919ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
28882025-03-25T01:21:01.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
28892025-03-25T01:21:01.921ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28902025-03-25T01:21:01.921ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
28912025-03-25T01:21:01.923ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
28922025-03-25T01:21:01.923ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
28932025-03-25T01:21:01.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
28942025-03-25T01:21:01.923ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
28952025-03-25T01:21:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
28962025-03-25T01:21:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
28972025-03-25T01:21:01.924ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
28982025-03-25T01:21:01.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
28992025-03-25T01:21:01.926ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 85134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 044b2036-2da5-4873-82bc-794cd213e567 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29002025-03-25T01:21:01.927ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
29012025-03-25T01:21:01.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
29022025-03-25T01:21:01.930ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
29032025-03-25T01:21:01.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
29042025-03-25T01:21:01.932ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 199.974662ms iteration = 4 status = 0
29052025-03-25T01:21:01.934ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
29062025-03-25T01:21:01.934ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 202.553009ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
29072025-03-25T01:21:01.943ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.972048ms iteration = 4 status = {}
29082025-03-25T01:21:01.958ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
29092025-03-25T01:21:01.958ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
29102025-03-25T01:21:01.958ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 224.840497ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
29112025-03-25T01:21:01.962ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 230.438087ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
29122025-03-25T01:21:01.962ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
29132025-03-25T01:21:01.963ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "37d51759-c71b-4e80-a6f1-a3cbc1bdef81", "content-length": "1", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29142025-03-25T01:21:01.964ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
29152025-03-25T01:21:01.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
29162025-03-25T01:21:01.971ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 238.769176ms iteration = 4 status = null
29172025-03-25T01:21:01.972ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
29182025-03-25T01:21:01.972ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 240.754575ms iteration = 4 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
29192025-03-25T01:21:01.981ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
29202025-03-25T01:21:01.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
29212025-03-25T01:21:01.982ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a72f6751-ee5b-4939-98ad-1d5fc44811eb", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29222025-03-25T01:21:01.982ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29232025-03-25T01:21:01.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29242025-03-25T01:21:01.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29252025-03-25T01:21:01.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29262025-03-25T01:21:01.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
29272025-03-25T01:21:01.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
29282025-03-25T01:21:01.993ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
29292025-03-25T01:21:01.993ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
29302025-03-25T01:21:01.993ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c562717a-7b27-4d2b-934b-9dd507fdb941", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29312025-03-25T01:21:01.995ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.0386ms iteration = 4 status = {}
29322025-03-25T01:21:02.003ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
29332025-03-25T01:21:02.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59668ff9-9973-4f7f-aa3c-e4ea05ffd53e", "content-length": "691", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29342025-03-25T01:21:02.004ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
29352025-03-25T01:21:02.004ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
29362025-03-25T01:21:02.004ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
29372025-03-25T01:21:02.005ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 273.026667ms iteration = 4 status = {}
29382025-03-25T01:21:02.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29392025-03-25T01:21:02.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29402025-03-25T01:21:02.072ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
29412025-03-25T01:21:02.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29422025-03-25T01:21:02.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29432025-03-25T01:21:02.088ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
29442025-03-25T01:21:02.089ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f246c55-037f-4c97-be2f-ae66d0927dc7", "content-length": "134", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29452025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
29462025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
29472025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
29482025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
29492025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29502025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29512025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29522025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29532025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
29542025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
29552025-03-25T01:21:02.089ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
29562025-03-25T01:21:02.089ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29572025-03-25T01:21:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29582025-03-25T01:21:02.093ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
29592025-03-25T01:21:02.093ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d418ec18-c928-457f-9663-1af80f4e5248", "content-length": "2", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29602025-03-25T01:21:02.093ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
29612025-03-25T01:21:02.093ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "38b4d60d-bc1e-4e09-89dc-bfc17677ad17", "content-length": "51", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29622025-03-25T01:21:02.093ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
29632025-03-25T01:21:02.093ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
29642025-03-25T01:21:02.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "95fce5f3-f38d-43c7-94cc-1c514b52d2ea", "date": "Tue, 25 Mar 2025 01:21:01 GMT"} })
29652025-03-25T01:21:02.276ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
29662025-03-25T01:21:02.276ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
29672025-03-25T01:21:02.276ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "596fdf26-5b75-4084-8730-fdc18dc824ae", "content-length": "682", "date": "Tue, 25 Mar 2025 01:21:02 GMT"} })
29682025-03-25T01:21:02.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29692025-03-25T01:21:02.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29702025-03-25T01:21:02.286ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29712025-03-25T01:21:02.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29722025-03-25T01:21:02.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29732025-03-25T01:21:02.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29742025-03-25T01:21:02.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
29752025-03-25T01:21:02.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
29762025-03-25T01:21:02.311ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 579.498822ms iteration = 4 status = {}
29772025-03-25T01:21:02.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a22704d-c650-4d8b-8657-e47efb5b2f60 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29782025-03-25T01:21:02.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a22704d-c650-4d8b-8657-e47efb5b2f60 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29792025-03-25T01:21:02.949ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a22704d-c650-4d8b-8657-e47efb5b2f60 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29802025-03-25T01:21:03.969ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 64eb8b08-9bc9-47bb-84e7-6a2ed3a9411d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29812025-03-25T01:21:03.969ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 64eb8b08-9bc9-47bb-84e7-6a2ed3a9411d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29822025-03-25T01:21:03.971ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 64eb8b08-9bc9-47bb-84e7-6a2ed3a9411d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29832025-03-25T01:21:04.993ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1f86a4e-73e5-4d89-b33c-f1e010b60539 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29842025-03-25T01:21:04.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1f86a4e-73e5-4d89-b33c-f1e010b60539 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29852025-03-25T01:21:04.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d1f86a4e-73e5-4d89-b33c-f1e010b60539 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29862025-03-25T01:21:05.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 764 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = f02b24a2-1d5f-4ef4-af7c-2960734c68a3 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
29872025-03-25T01:21:06.016ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 127ff00a-beb1-45be-8c46-fb6b1b121db3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29882025-03-25T01:21:06.017ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 127ff00a-beb1-45be-8c46-fb6b1b121db3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29892025-03-25T01:21:06.019ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2289 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 127ff00a-beb1-45be-8c46-fb6b1b121db3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29902025-03-25T01:21:07.039ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dc28fa98-98e0-46b3-9e4d-8e838033f229 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29912025-03-25T01:21:07.039ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dc28fa98-98e0-46b3-9e4d-8e838033f229 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29922025-03-25T01:21:07.041ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2032 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dc28fa98-98e0-46b3-9e4d-8e838033f229 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29932025-03-25T01:21:08.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b2d0ce5-2573-4b0f-9071-a50b917fa2ad roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29942025-03-25T01:21:08.061ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b2d0ce5-2573-4b0f-9071-a50b917fa2ad resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29952025-03-25T01:21:08.063ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2530 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b2d0ce5-2573-4b0f-9071-a50b917fa2ad response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29962025-03-25T01:21:09.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e8a9fcb9-1ddc-4697-81f3-4ec732a315ea roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29972025-03-25T01:21:09.085ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e8a9fcb9-1ddc-4697-81f3-4ec732a315ea resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29982025-03-25T01:21:09.087ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2748 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e8a9fcb9-1ddc-4697-81f3-4ec732a315ea response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
29992025-03-25T01:21:10.107ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9fb6097-f403-4478-acc0-a07d3a7facf0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30002025-03-25T01:21:10.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9fb6097-f403-4478-acc0-a07d3a7facf0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30012025-03-25T01:21:10.109ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1904 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9fb6097-f403-4478-acc0-a07d3a7facf0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30022025-03-25T01:21:11.130ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0e02255-0f63-4f3a-a1e1-cb4bb58b3ae3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30032025-03-25T01:21:11.130ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0e02255-0f63-4f3a-a1e1-cb4bb58b3ae3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30042025-03-25T01:21:11.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2113 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0e02255-0f63-4f3a-a1e1-cb4bb58b3ae3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30052025-03-25T01:21:11.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
30062025-03-25T01:21:11.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30072025-03-25T01:21:11.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30082025-03-25T01:21:11.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
30092025-03-25T01:21:11.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30102025-03-25T01:21:11.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30112025-03-25T01:21:11.766ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30122025-03-25T01:21:11.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30132025-03-25T01:21:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30142025-03-25T01:21:11.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30152025-03-25T01:21:11.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30162025-03-25T01:21:11.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30172025-03-25T01:21:11.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.04104ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30182025-03-25T01:21:11.771ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30192025-03-25T01:21:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30202025-03-25T01:21:11.773ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30212025-03-25T01:21:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
30222025-03-25T01:21:11.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30232025-03-25T01:21:11.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30242025-03-25T01:21:11.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
30252025-03-25T01:21:11.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.694656ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
30262025-03-25T01:21:12.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52b7791b-00e7-49c5-8fdf-48e572f28010 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30272025-03-25T01:21:12.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52b7791b-00e7-49c5-8fdf-48e572f28010 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30282025-03-25T01:21:12.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2131 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52b7791b-00e7-49c5-8fdf-48e572f28010 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30292025-03-25T01:21:13.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28e1134a-2d22-4cb4-b7c2-17a4da3d4e47 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30302025-03-25T01:21:13.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28e1134a-2d22-4cb4-b7c2-17a4da3d4e47 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30312025-03-25T01:21:13.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28e1134a-2d22-4cb4-b7c2-17a4da3d4e47 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30322025-03-25T01:21:14.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb51871a-f584-4275-86c4-1f0f6f0d2f6a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30332025-03-25T01:21:14.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb51871a-f584-4275-86c4-1f0f6f0d2f6a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30342025-03-25T01:21:14.199ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb51871a-f584-4275-86c4-1f0f6f0d2f6a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30352025-03-25T01:21:15.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76604d8d-ed2f-48f8-b91d-3ce03fae5161 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30362025-03-25T01:21:15.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76604d8d-ed2f-48f8-b91d-3ce03fae5161 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30372025-03-25T01:21:15.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76604d8d-ed2f-48f8-b91d-3ce03fae5161 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30382025-03-25T01:21:15.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 444 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 47e890e5-793c-48ff-bd76-4bde4762e39d response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
30392025-03-25T01:21:16.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cefe2894-b3d3-4d77-87b8-f8549a11daa0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30402025-03-25T01:21:16.242ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cefe2894-b3d3-4d77-87b8-f8549a11daa0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30412025-03-25T01:21:16.244ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2242 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cefe2894-b3d3-4d77-87b8-f8549a11daa0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30422025-03-25T01:21:17.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b4f115d0-a61a-44b9-830b-897d56420746 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30432025-03-25T01:21:17.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b4f115d0-a61a-44b9-830b-897d56420746 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30442025-03-25T01:21:17.266ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1758 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b4f115d0-a61a-44b9-830b-897d56420746 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30452025-03-25T01:21:18.286ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d108cf2e-876a-464b-8aea-fdc57931444d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30462025-03-25T01:21:18.286ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d108cf2e-876a-464b-8aea-fdc57931444d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30472025-03-25T01:21:18.288ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1894 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d108cf2e-876a-464b-8aea-fdc57931444d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30482025-03-25T01:21:19.308ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ceef9-0f9f-4d32-87ea-746fb19fc628 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30492025-03-25T01:21:19.309ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ceef9-0f9f-4d32-87ea-746fb19fc628 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30502025-03-25T01:21:19.311ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2592 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ceef9-0f9f-4d32-87ea-746fb19fc628 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30512025-03-25T01:21:20.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5dd6f8df-3985-4ab0-8aaf-d13e8116c343 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30522025-03-25T01:21:20.332ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5dd6f8df-3985-4ab0-8aaf-d13e8116c343 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30532025-03-25T01:21:20.334ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2130 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5dd6f8df-3985-4ab0-8aaf-d13e8116c343 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30542025-03-25T01:21:21.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 159bc9d3-b9b1-4078-87a5-d18e01a7e2fe roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30552025-03-25T01:21:21.355ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 159bc9d3-b9b1-4078-87a5-d18e01a7e2fe resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30562025-03-25T01:21:21.356ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 159bc9d3-b9b1-4078-87a5-d18e01a7e2fe response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30572025-03-25T01:21:21.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
30582025-03-25T01:21:21.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30592025-03-25T01:21:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30602025-03-25T01:21:21.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
30612025-03-25T01:21:21.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30622025-03-25T01:21:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30632025-03-25T01:21:21.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30642025-03-25T01:21:21.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
30652025-03-25T01:21:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
30662025-03-25T01:21:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
30672025-03-25T01:21:21.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30682025-03-25T01:21:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30692025-03-25T01:21:21.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30702025-03-25T01:21:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30712025-03-25T01:21:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
30722025-03-25T01:21:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
30732025-03-25T01:21:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
30742025-03-25T01:21:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
30752025-03-25T01:21:21.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
30762025-03-25T01:21:21.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.599316ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
30772025-03-25T01:21:21.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.55141ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
30782025-03-25T01:21:22.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 51f0c7b0-2b14-4cee-b791-d436bfbba98a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30792025-03-25T01:21:22.377ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 51f0c7b0-2b14-4cee-b791-d436bfbba98a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30802025-03-25T01:21:22.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2158 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 51f0c7b0-2b14-4cee-b791-d436bfbba98a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30812025-03-25T01:21:23.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9956058c-0e24-40d4-9a30-71525ae658b6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30822025-03-25T01:21:23.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9956058c-0e24-40d4-9a30-71525ae658b6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30832025-03-25T01:21:23.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9956058c-0e24-40d4-9a30-71525ae658b6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30842025-03-25T01:21:24.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7323d9c-d372-4a8e-9af8-dc19280087d3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30852025-03-25T01:21:24.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7323d9c-d372-4a8e-9af8-dc19280087d3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30862025-03-25T01:21:24.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7323d9c-d372-4a8e-9af8-dc19280087d3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30872025-03-25T01:21:25.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b5012684-85e5-4836-8563-cae4da472b83 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30882025-03-25T01:21:25.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b5012684-85e5-4836-8563-cae4da472b83 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30892025-03-25T01:21:25.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2396 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b5012684-85e5-4836-8563-cae4da472b83 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30902025-03-25T01:21:25.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 477 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = d70fcc80-f903-4c23-b32b-5c5007242065 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
30912025-03-25T01:21:26.468ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36ef968b-2560-40b0-92e6-33fe9b5529dd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30922025-03-25T01:21:26.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36ef968b-2560-40b0-92e6-33fe9b5529dd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30932025-03-25T01:21:26.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2203 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36ef968b-2560-40b0-92e6-33fe9b5529dd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30942025-03-25T01:21:27.491ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20394937-aa60-4917-9bb0-57a9438bed17 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30952025-03-25T01:21:27.491ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20394937-aa60-4917-9bb0-57a9438bed17 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30962025-03-25T01:21:27.493ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2327 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20394937-aa60-4917-9bb0-57a9438bed17 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30972025-03-25T01:21:28.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f01267c2-f4c0-462d-b958-3ee2b5ea2895 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30982025-03-25T01:21:28.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f01267c2-f4c0-462d-b958-3ee2b5ea2895 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
30992025-03-25T01:21:28.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f01267c2-f4c0-462d-b958-3ee2b5ea2895 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31002025-03-25T01:21:29.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a622eb72-dc94-40aa-b789-19b2b32ff1b4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31012025-03-25T01:21:29.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a622eb72-dc94-40aa-b789-19b2b32ff1b4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31022025-03-25T01:21:29.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a622eb72-dc94-40aa-b789-19b2b32ff1b4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31032025-03-25T01:21:30.560ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a47abd4c-b5a7-4056-998f-be6f6685531a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31042025-03-25T01:21:30.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a47abd4c-b5a7-4056-998f-be6f6685531a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31052025-03-25T01:21:30.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1857 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a47abd4c-b5a7-4056-998f-be6f6685531a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31062025-03-25T01:21:30.752ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:58223
31072025-03-25T01:21:30.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = fefd9b43-1965-43ef-83ec-865eaff8f555 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
31082025-03-25T01:21:30.752ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = fefd9b43-1965-43ef-83ec-865eaff8f555 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
31092025-03-25T01:21:30.754ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1942 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = fefd9b43-1965-43ef-83ec-865eaff8f555 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
31102025-03-25T01:21:30.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 6ed6e6df-9fac-4722-b8d2-84a37e9c1752 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
31112025-03-25T01:21:30.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 6ed6e6df-9fac-4722-b8d2-84a37e9c1752 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
31122025-03-25T01:21:30.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 6ed6e6df-9fac-4722-b8d2-84a37e9c1752 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
31132025-03-25T01:21:31.583ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b052d9ca-f626-44a5-9ee7-f586d5b3cd7c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31142025-03-25T01:21:31.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b052d9ca-f626-44a5-9ee7-f586d5b3cd7c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31152025-03-25T01:21:31.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2249 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b052d9ca-f626-44a5-9ee7-f586d5b3cd7c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
31162025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
31172025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
31182025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
31192025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
31202025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
31212025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
31222025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
31232025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
31242025-03-25T01:21:31.733ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
31252025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
31262025-03-25T01:21:31.733ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:11:31.733247178 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
31272025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
31282025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
31292025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
31302025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
31312025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
31322025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
31332025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
31342025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
31352025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
31362025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
31372025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
31382025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
31392025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
31402025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
31412025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
31422025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
31432025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
31442025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
31452025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
31462025-03-25T01:21:31.733ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
31472025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
31482025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.981\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
31492025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
31502025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
31512025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
31522025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 5 reason = Timeout
31532025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
31542025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
31552025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
31562025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
31572025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
31582025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 5 reason = Timeout
31592025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
31602025-03-25T01:21:31.733ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
31612025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
31622025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
31632025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
31642025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
31652025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
31662025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
31672025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
31682025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
31692025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
31702025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
31712025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
31722025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
31732025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
31742025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
31752025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
31762025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
31772025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
31782025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
31792025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
31802025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
31812025-03-25T01:21:31.733ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
31822025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
31832025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
31842025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
31852025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
31862025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
31872025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
31882025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
31892025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
31902025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
31912025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
31922025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
31932025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
31942025-03-25T01:21:31.734ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 451834153 } })
31952025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
31962025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
31972025-03-25T01:21:31.734ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 451841393 } })
31982025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
31992025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32002025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
32012025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32022025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
32032025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32042025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
32052025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
32062025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32072025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32082025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
32092025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
32102025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
32112025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.35636ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
32122025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
32132025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.468181ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
32142025-03-25T01:21:31.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
32152025-03-25T01:21:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
32162025-03-25T01:21:31.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32172025-03-25T01:21:31.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32182025-03-25T01:21:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32192025-03-25T01:21:31.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32202025-03-25T01:21:31.737ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32212025-03-25T01:21:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32222025-03-25T01:21:31.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32232025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.883624ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
32242025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
32252025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32262025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32272025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
32282025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
32292025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
32302025-03-25T01:21:31.739ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:11:31.733247178 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
32312025-03-25T01:21:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.455542ms iteration = 3 status = {"expiration":"2025-03-25T01:11:31.733247178Z","pruned":[]}
32322025-03-25T01:21:31.739ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 457734817 } })
32332025-03-25T01:21:31.740ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
32342025-03-25T01:21:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
32352025-03-25T01:21:31.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32362025-03-25T01:21:31.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32372025-03-25T01:21:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32382025-03-25T01:21:31.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
32392025-03-25T01:21:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
32402025-03-25T01:21:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
32412025-03-25T01:21:31.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
32422025-03-25T01:21:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
32432025-03-25T01:21:31.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 461979698 } })
32442025-03-25T01:21:31.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
32452025-03-25T01:21:31.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32462025-03-25T01:21:31.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
32472025-03-25T01:21:31.746ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
32482025-03-25T01:21:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
32492025-03-25T01:21:31.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32502025-03-25T01:21:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
32512025-03-25T01:21:31.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
32522025-03-25T01:21:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
32532025-03-25T01:21:31.756ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.600844ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
32542025-03-25T01:21:31.759ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32552025-03-25T01:21:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32562025-03-25T01:21:31.761ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32572025-03-25T01:21:31.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
32582025-03-25T01:21:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
32592025-03-25T01:21:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32602025-03-25T01:21:31.769ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 995, tv_nsec: 487043116 } })
32612025-03-25T01:21:31.769ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
32622025-03-25T01:21:31.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32632025-03-25T01:21:31.807ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
32642025-03-25T01:21:31.807ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32652025-03-25T01:21:31.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32662025-03-25T01:21:31.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 83.987482ms iteration = 5 status = {"errors":[],"finish_invoked_ok":[]}
32672025-03-25T01:21:31.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
32682025-03-25T01:21:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
32692025-03-25T01:21:31.819ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
32702025-03-25T01:21:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
32712025-03-25T01:21:31.820ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32722025-03-25T01:21:31.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32732025-03-25T01:21:31.823ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
32742025-03-25T01:21:31.823ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
32752025-03-25T01:21:31.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
32762025-03-25T01:21:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
32772025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
32782025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
32792025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
32802025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
32812025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
32822025-03-25T01:21:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
32832025-03-25T01:21:31.826ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
32842025-03-25T01:21:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
32852025-03-25T01:21:31.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 97.812989ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32862025-03-25T01:21:31.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 98.395508ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
32872025-03-25T01:21:31.835ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32882025-03-25T01:21:31.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
32892025-03-25T01:21:31.835ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 102.286764ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
32902025-03-25T01:21:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
32912025-03-25T01:21:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
32922025-03-25T01:21:31.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32932025-03-25T01:21:31.842ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
32942025-03-25T01:21:31.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
32952025-03-25T01:21:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
32962025-03-25T01:21:31.842ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
32972025-03-25T01:21:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 109.521617ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
32982025-03-25T01:21:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
32992025-03-25T01:21:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33002025-03-25T01:21:31.844ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
33012025-03-25T01:21:31.844ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
33022025-03-25T01:21:31.844ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 110.568782ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
33032025-03-25T01:21:31.845ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
33042025-03-25T01:21:31.845ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
33052025-03-25T01:21:31.845ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 112.708803ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
33062025-03-25T01:21:31.846ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33072025-03-25T01:21:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
33082025-03-25T01:21:31.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
33092025-03-25T01:21:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
33102025-03-25T01:21:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33112025-03-25T01:21:31.850ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 116.971084ms iteration = 5 status = {"errors":[],"requests_created_ok":[]}
33122025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
33132025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
33142025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
33152025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33162025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33172025-03-25T01:21:31.852ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33182025-03-25T01:21:31.855ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33192025-03-25T01:21:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33202025-03-25T01:21:31.855ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
33212025-03-25T01:21:31.855ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
33222025-03-25T01:21:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
33232025-03-25T01:21:31.879ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
33242025-03-25T01:21:31.882ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
33252025-03-25T01:21:31.882ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 149.55676ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
33262025-03-25T01:21:31.890ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33272025-03-25T01:21:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33282025-03-25T01:21:31.892ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33292025-03-25T01:21:31.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
33302025-03-25T01:21:31.895ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
33312025-03-25T01:21:31.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
33322025-03-25T01:21:31.897ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33332025-03-25T01:21:31.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
33342025-03-25T01:21:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33352025-03-25T01:21:31.898ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
33362025-03-25T01:21:31.902ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
33372025-03-25T01:21:31.902ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 169.066569ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
33382025-03-25T01:21:31.906ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33392025-03-25T01:21:31.906ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
33402025-03-25T01:21:31.906ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
33412025-03-25T01:21:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
33422025-03-25T01:21:31.909ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
33432025-03-25T01:21:31.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
33442025-03-25T01:21:31.911ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
33452025-03-25T01:21:31.911ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
33462025-03-25T01:21:31.911ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
33472025-03-25T01:21:31.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33482025-03-25T01:21:31.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33492025-03-25T01:21:31.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33502025-03-25T01:21:31.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
33512025-03-25T01:21:31.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
33522025-03-25T01:21:31.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
33532025-03-25T01:21:31.924ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
33542025-03-25T01:21:31.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
33552025-03-25T01:21:31.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33562025-03-25T01:21:31.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33572025-03-25T01:21:31.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33582025-03-25T01:21:31.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33592025-03-25T01:21:31.936ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
33602025-03-25T01:21:31.936ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
33612025-03-25T01:21:31.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33622025-03-25T01:21:31.936ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33632025-03-25T01:21:31.936ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33642025-03-25T01:21:31.938ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33652025-03-25T01:21:31.938ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
33662025-03-25T01:21:31.938ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
33672025-03-25T01:21:31.939ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
33682025-03-25T01:21:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
33692025-03-25T01:21:31.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
33702025-03-25T01:21:31.943ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
33712025-03-25T01:21:31.945ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
33722025-03-25T01:21:31.945ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
33732025-03-25T01:21:31.945ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c215a290-7f1e-4af7-bd7a-cf80c4328c84", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:31 GMT"} })
33742025-03-25T01:21:31.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
33752025-03-25T01:21:31.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
33762025-03-25T01:21:31.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
33772025-03-25T01:21:31.947ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
33782025-03-25T01:21:31.947ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 213.595917ms iteration = 3 status = {"generation":1}
33792025-03-25T01:21:31.948ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
33802025-03-25T01:21:31.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33812025-03-25T01:21:31.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33822025-03-25T01:21:31.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33832025-03-25T01:21:31.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33842025-03-25T01:21:31.965ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
33852025-03-25T01:21:31.965ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 232.579549ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
33862025-03-25T01:21:31.968ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33872025-03-25T01:21:31.970ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33882025-03-25T01:21:31.970ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33892025-03-25T01:21:31.970ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
33902025-03-25T01:21:31.970ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
33912025-03-25T01:21:31.970ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 237.149194ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
33922025-03-25T01:21:31.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33932025-03-25T01:21:31.971ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33942025-03-25T01:21:31.972ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
33952025-03-25T01:21:31.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
33962025-03-25T01:21:31.975ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
33972025-03-25T01:21:31.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
33982025-03-25T01:21:31.975ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
33992025-03-25T01:21:31.975ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
34002025-03-25T01:21:31.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
34012025-03-25T01:21:31.976ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 243.22206ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
34022025-03-25T01:21:31.979ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 245.832828ms iteration = 5 status = 0
34032025-03-25T01:21:31.982ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
34042025-03-25T01:21:31.982ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 249.337888ms iteration = 5 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
34052025-03-25T01:21:31.986ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
34062025-03-25T01:21:31.986ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
34072025-03-25T01:21:31.986ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34082025-03-25T01:21:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34092025-03-25T01:21:31.988ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
34102025-03-25T01:21:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
34112025-03-25T01:21:31.991ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
34122025-03-25T01:21:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
34132025-03-25T01:21:31.993ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
34142025-03-25T01:21:31.993ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
34152025-03-25T01:21:31.993ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
34162025-03-25T01:21:31.993ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 260.439547ms iteration = 3 status = {"generation":2}
34172025-03-25T01:21:31.997ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 264.357283ms iteration = 7 status = {"physical_disks_added":0}
34182025-03-25T01:21:32.001ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
34192025-03-25T01:21:32.001ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 267.942944ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
34202025-03-25T01:21:32.017ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
34212025-03-25T01:21:32.017ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34222025-03-25T01:21:32.018ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "64e8941d-9782-44c5-a71e-cbe64ba90f8e", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:31 GMT"} })
34232025-03-25T01:21:32.018ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34242025-03-25T01:21:32.019ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
34252025-03-25T01:21:32.038ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
34262025-03-25T01:21:32.128ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
34272025-03-25T01:21:32.129ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
34282025-03-25T01:21:32.129ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a1df4efd-6624-4e54-86b8-fc93ee0853cd", "content-length": "26", "date": "Tue, 25 Mar 2025 01:21:31 GMT"} })
34292025-03-25T01:21:32.129ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
34302025-03-25T01:21:32.131ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
34312025-03-25T01:21:32.178ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
34322025-03-25T01:21:32.179ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7422fe20-6b89-42c9-9779-c0606363fbf9", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34332025-03-25T01:21:32.179ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34342025-03-25T01:21:32.180ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "622ae29d-aa1e-4518-a8ca-2919515de920", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34352025-03-25T01:21:32.180ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34362025-03-25T01:21:32.185ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
34372025-03-25T01:21:32.185ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 452.202201ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
34382025-03-25T01:21:32.187ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 453.612021ms iteration = 5 status = {}
34392025-03-25T01:21:32.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
34402025-03-25T01:21:32.256ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bc612ee-b98e-4230-bb7a-60d2023078e0", "content-length": "691", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34412025-03-25T01:21:32.256ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
34422025-03-25T01:21:32.256ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
34432025-03-25T01:21:32.256ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
34442025-03-25T01:21:32.257ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
34452025-03-25T01:21:32.257ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34462025-03-25T01:21:32.257ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "52dad587-7649-403a-9c6f-a59390b26bb1", "content-length": "372", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34472025-03-25T01:21:32.257ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34482025-03-25T01:21:32.257ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 524.552566ms iteration = 5 status = {}
34492025-03-25T01:21:32.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34502025-03-25T01:21:32.298ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
34512025-03-25T01:21:32.298ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6916fee3-c3bb-4b79-9f95-06026dc0cdcf", "content-length": "1", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34522025-03-25T01:21:32.300ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
34532025-03-25T01:21:32.300ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
34542025-03-25T01:21:32.300ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
34552025-03-25T01:21:32.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
34562025-03-25T01:21:32.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a0da70e3-51dd-4d24-a9ac-58a8bd612467", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34572025-03-25T01:21:32.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34582025-03-25T01:21:32.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34592025-03-25T01:21:32.303ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 569.862204ms iteration = 5 status = null
34602025-03-25T01:21:32.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34612025-03-25T01:21:32.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34622025-03-25T01:21:32.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
34632025-03-25T01:21:32.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
34642025-03-25T01:21:32.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
34652025-03-25T01:21:32.310ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
34662025-03-25T01:21:32.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
34672025-03-25T01:21:32.311ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69b30ecf-89f8-4520-8bea-e2b897314239", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34682025-03-25T01:21:32.312ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 578.833063ms iteration = 5 status = {}
34692025-03-25T01:21:32.344ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
34702025-03-25T01:21:32.344ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7d59be57-f440-4c0c-b866-4be08ac0b872", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34712025-03-25T01:21:32.344ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34722025-03-25T01:21:32.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "05d726fe-5bb4-44a5-9536-1a316d799fd1", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34732025-03-25T01:21:32.346ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34742025-03-25T01:21:32.347ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6d91bd45-480b-4fc6-bb4c-6577a585da39", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34752025-03-25T01:21:32.347ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34762025-03-25T01:21:32.349ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
34772025-03-25T01:21:32.349ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 616.096236ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
34782025-03-25T01:21:32.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34792025-03-25T01:21:32.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34802025-03-25T01:21:32.362ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
34812025-03-25T01:21:32.362ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34822025-03-25T01:21:32.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34832025-03-25T01:21:32.372ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
34842025-03-25T01:21:32.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b44a2fe-a033-4fa8-86e3-61f1c22a9b7f", "content-length": "134", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
34852025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
34862025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
34872025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
34882025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
34892025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34902025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34912025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34922025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34932025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
34942025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
34952025-03-25T01:21:32.373ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
34962025-03-25T01:21:32.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
34972025-03-25T01:21:32.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
34982025-03-25T01:21:32.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
34992025-03-25T01:21:32.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d445750-4d20-4976-b66d-ac83606aaae0", "content-length": "2", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
35002025-03-25T01:21:32.376ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
35012025-03-25T01:21:32.376ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4551f19e-f3e0-4a76-844e-8f90623ad665", "content-length": "51", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
35022025-03-25T01:21:32.376ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
35032025-03-25T01:21:32.376ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
35042025-03-25T01:21:32.479ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "be6ce09d-8ba2-4d55-9d9d-5bab0933e6d6", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
35052025-03-25T01:21:32.479ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
35062025-03-25T01:21:32.479ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
35072025-03-25T01:21:32.480ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f1658b85-14e2-4371-859e-e4600e56ea36", "content-length": "682", "date": "Tue, 25 Mar 2025 01:21:32 GMT"} })
35082025-03-25T01:21:32.480ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35092025-03-25T01:21:32.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35102025-03-25T01:21:32.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35112025-03-25T01:21:32.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35122025-03-25T01:21:32.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35132025-03-25T01:21:32.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35142025-03-25T01:21:32.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
35152025-03-25T01:21:32.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
35162025-03-25T01:21:32.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 764.50689ms iteration = 5 status = {}
35172025-03-25T01:21:32.672ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48d9d4ba-b96d-405c-9336-ff91e329b8af roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35182025-03-25T01:21:32.672ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48d9d4ba-b96d-405c-9336-ff91e329b8af resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35192025-03-25T01:21:32.674ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2631 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48d9d4ba-b96d-405c-9336-ff91e329b8af response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35202025-03-25T01:21:33.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc185d73-a7b5-46a6-a2b6-aab20409a502 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35212025-03-25T01:21:33.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc185d73-a7b5-46a6-a2b6-aab20409a502 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35222025-03-25T01:21:33.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2261 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc185d73-a7b5-46a6-a2b6-aab20409a502 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35232025-03-25T01:21:34.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = adc0f7c3-c593-4f42-87fe-12e7f129cb68 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35242025-03-25T01:21:34.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = adc0f7c3-c593-4f42-87fe-12e7f129cb68 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35252025-03-25T01:21:34.716ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2413 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = adc0f7c3-c593-4f42-87fe-12e7f129cb68 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35262025-03-25T01:21:35.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5570242-8023-4100-b622-974e771cfb7c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35272025-03-25T01:21:35.736ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5570242-8023-4100-b622-974e771cfb7c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35282025-03-25T01:21:35.738ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5570242-8023-4100-b622-974e771cfb7c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35292025-03-25T01:21:35.759ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 319ec39e-a0d8-4283-80fe-8095c40735ec response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
35302025-03-25T01:21:36.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 593f2ae2-e381-4b83-94dd-3188d426f978 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35312025-03-25T01:21:36.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 593f2ae2-e381-4b83-94dd-3188d426f978 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35322025-03-25T01:21:36.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 593f2ae2-e381-4b83-94dd-3188d426f978 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35332025-03-25T01:21:37.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b591ba6-95ad-45f2-bb88-dc61779cf087 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35342025-03-25T01:21:37.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b591ba6-95ad-45f2-bb88-dc61779cf087 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35352025-03-25T01:21:37.782ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b591ba6-95ad-45f2-bb88-dc61779cf087 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35362025-03-25T01:21:38.802ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ca808733-4fd5-4d8d-b7d9-150d40b0cad0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35372025-03-25T01:21:38.802ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ca808733-4fd5-4d8d-b7d9-150d40b0cad0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35382025-03-25T01:21:38.804ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2526 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ca808733-4fd5-4d8d-b7d9-150d40b0cad0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35392025-03-25T01:21:39.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 29cf47ac-e6e3-45fd-98d3-cedf3fd0f06c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35402025-03-25T01:21:39.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 29cf47ac-e6e3-45fd-98d3-cedf3fd0f06c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35412025-03-25T01:21:39.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1723 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 29cf47ac-e6e3-45fd-98d3-cedf3fd0f06c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35422025-03-25T01:21:40.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5356ef5-2b72-4ebd-aa7c-ca88ee297a2e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35432025-03-25T01:21:40.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5356ef5-2b72-4ebd-aa7c-ca88ee297a2e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35442025-03-25T01:21:40.850ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5356ef5-2b72-4ebd-aa7c-ca88ee297a2e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35452025-03-25T01:21:41.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
35462025-03-25T01:21:41.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35472025-03-25T01:21:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35482025-03-25T01:21:41.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
35492025-03-25T01:21:41.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35502025-03-25T01:21:41.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35512025-03-25T01:21:41.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35522025-03-25T01:21:41.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
35532025-03-25T01:21:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
35542025-03-25T01:21:41.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
35552025-03-25T01:21:41.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35562025-03-25T01:21:41.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35572025-03-25T01:21:41.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35582025-03-25T01:21:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35592025-03-25T01:21:41.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35602025-03-25T01:21:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
35612025-03-25T01:21:41.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 39.050269ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
35622025-03-25T01:21:41.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35632025-03-25T01:21:41.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
35642025-03-25T01:21:41.783ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
35652025-03-25T01:21:41.783ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.654025ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
35662025-03-25T01:21:41.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 07b3fff9-c78b-48bf-aa30-45329a77d642 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35672025-03-25T01:21:41.870ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 07b3fff9-c78b-48bf-aa30-45329a77d642 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35682025-03-25T01:21:41.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 07b3fff9-c78b-48bf-aa30-45329a77d642 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35692025-03-25T01:21:42.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b88f06e1-c5ea-499e-8010-403b5a922861 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35702025-03-25T01:21:42.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b88f06e1-c5ea-499e-8010-403b5a922861 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35712025-03-25T01:21:42.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2290 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b88f06e1-c5ea-499e-8010-403b5a922861 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35722025-03-25T01:21:43.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a2d2a6b-3242-4bd0-9118-a7d8a9c0121d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35732025-03-25T01:21:43.916ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a2d2a6b-3242-4bd0-9118-a7d8a9c0121d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35742025-03-25T01:21:43.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a2d2a6b-3242-4bd0-9118-a7d8a9c0121d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35752025-03-25T01:21:44.936ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73bfbb5f-ef90-4425-93be-90fa3bf074c3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35762025-03-25T01:21:44.936ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73bfbb5f-ef90-4425-93be-90fa3bf074c3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35772025-03-25T01:21:44.938ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1824 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73bfbb5f-ef90-4425-93be-90fa3bf074c3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35782025-03-25T01:21:45.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 608 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 49badfce-9fa4-4d4b-b12b-c9e6949e70ee response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
35792025-03-25T01:21:45.959ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73047364-8267-44a8-b864-9085c8e1cec7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35802025-03-25T01:21:45.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73047364-8267-44a8-b864-9085c8e1cec7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35812025-03-25T01:21:45.962ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2648 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 73047364-8267-44a8-b864-9085c8e1cec7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35822025-03-25T01:21:46.982ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 01faf67f-9610-4d89-ba77-086e8b53a6ff roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35832025-03-25T01:21:46.983ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 01faf67f-9610-4d89-ba77-086e8b53a6ff resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35842025-03-25T01:21:46.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2372 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 01faf67f-9610-4d89-ba77-086e8b53a6ff response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35852025-03-25T01:21:48.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0154cfca-a762-41ff-9e77-4e25556b6639 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35862025-03-25T01:21:48.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0154cfca-a762-41ff-9e77-4e25556b6639 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35872025-03-25T01:21:48.006ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1906 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0154cfca-a762-41ff-9e77-4e25556b6639 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35882025-03-25T01:21:49.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57c3f08f-3fdb-4e11-9ecb-20661c973b82 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35892025-03-25T01:21:49.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57c3f08f-3fdb-4e11-9ecb-20661c973b82 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35902025-03-25T01:21:49.029ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2023 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57c3f08f-3fdb-4e11-9ecb-20661c973b82 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35912025-03-25T01:21:50.051ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b0ab00b-a714-4732-b36c-3a50d253df82 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35922025-03-25T01:21:50.051ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b0ab00b-a714-4732-b36c-3a50d253df82 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35932025-03-25T01:21:50.053ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2754 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b0ab00b-a714-4732-b36c-3a50d253df82 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35942025-03-25T01:21:51.073ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f748885-4284-4fc5-a67b-c5f4fa25aea9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35952025-03-25T01:21:51.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f748885-4284-4fc5-a67b-c5f4fa25aea9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35962025-03-25T01:21:51.075ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2344 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f748885-4284-4fc5-a67b-c5f4fa25aea9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
35972025-03-25T01:21:51.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
35982025-03-25T01:21:51.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
35992025-03-25T01:21:51.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36002025-03-25T01:21:51.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
36012025-03-25T01:21:51.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36022025-03-25T01:21:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36032025-03-25T01:21:51.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36042025-03-25T01:21:51.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36052025-03-25T01:21:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
36062025-03-25T01:21:51.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
36072025-03-25T01:21:51.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36082025-03-25T01:21:51.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36092025-03-25T01:21:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36102025-03-25T01:21:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36112025-03-25T01:21:51.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36122025-03-25T01:21:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
36132025-03-25T01:21:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36142025-03-25T01:21:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36152025-03-25T01:21:51.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
36162025-03-25T01:21:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.248171ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
36172025-03-25T01:21:51.766ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.112444ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
36182025-03-25T01:21:52.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b425907-1d8e-4549-87a8-62b9922beee4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36192025-03-25T01:21:52.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b425907-1d8e-4549-87a8-62b9922beee4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36202025-03-25T01:21:52.098ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b425907-1d8e-4549-87a8-62b9922beee4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36212025-03-25T01:21:53.118ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55b9e661-5cc3-45d7-9296-9cbdd74cb0a0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36222025-03-25T01:21:53.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55b9e661-5cc3-45d7-9296-9cbdd74cb0a0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36232025-03-25T01:21:53.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2126 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55b9e661-5cc3-45d7-9296-9cbdd74cb0a0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36242025-03-25T01:21:54.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06711e09-e3d5-4c21-bc20-254e9cc4208f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36252025-03-25T01:21:54.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06711e09-e3d5-4c21-bc20-254e9cc4208f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36262025-03-25T01:21:54.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2326 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06711e09-e3d5-4c21-bc20-254e9cc4208f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36272025-03-25T01:21:55.164ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cdd91b02-649a-41a5-927d-47141e5dfc2a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36282025-03-25T01:21:55.164ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cdd91b02-649a-41a5-927d-47141e5dfc2a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36292025-03-25T01:21:55.166ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2365 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cdd91b02-649a-41a5-927d-47141e5dfc2a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36302025-03-25T01:21:55.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 422 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 307496c7-4929-4d19-b837-665e22031e62 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
36312025-03-25T01:21:56.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8713394f-4392-4069-bdc1-5f3e167cd54d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36322025-03-25T01:21:56.187ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8713394f-4392-4069-bdc1-5f3e167cd54d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36332025-03-25T01:21:56.189ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2240 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8713394f-4392-4069-bdc1-5f3e167cd54d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36342025-03-25T01:21:57.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ab68aea-04ca-417b-bade-0acb1b6623d7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36352025-03-25T01:21:57.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ab68aea-04ca-417b-bade-0acb1b6623d7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36362025-03-25T01:21:57.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2433 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ab68aea-04ca-417b-bade-0acb1b6623d7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36372025-03-25T01:21:58.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6cd0ad57-bfc0-4034-ab03-4266dfa4a02d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36382025-03-25T01:21:58.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6cd0ad57-bfc0-4034-ab03-4266dfa4a02d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36392025-03-25T01:21:58.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1750 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6cd0ad57-bfc0-4034-ab03-4266dfa4a02d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36402025-03-25T01:21:59.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 68ebbfd1-39aa-40e3-9866-72a20dd671fe roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36412025-03-25T01:21:59.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 68ebbfd1-39aa-40e3-9866-72a20dd671fe resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36422025-03-25T01:21:59.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2708 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 68ebbfd1-39aa-40e3-9866-72a20dd671fe response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36432025-03-25T01:22:00.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48fe2299-e5ee-40b8-b322-56f529735bb1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36442025-03-25T01:22:00.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48fe2299-e5ee-40b8-b322-56f529735bb1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36452025-03-25T01:22:00.278ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1877 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48fe2299-e5ee-40b8-b322-56f529735bb1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36462025-03-25T01:22:00.752ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 5829742e-2202-4c31-b1f3-424d36ac18c8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
36472025-03-25T01:22:00.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 5829742e-2202-4c31-b1f3-424d36ac18c8 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
36482025-03-25T01:22:00.755ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3317 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 5829742e-2202-4c31-b1f3-424d36ac18c8 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
36492025-03-25T01:22:00.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 63c726f1-5d36-4e8f-ab72-ed25ea0a2f61 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
36502025-03-25T01:22:00.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 63c726f1-5d36-4e8f-ab72-ed25ea0a2f61 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
36512025-03-25T01:22:00.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:58223 req_id = 63c726f1-5d36-4e8f-ab72-ed25ea0a2f61 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
36522025-03-25T01:22:01.300ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bece1b10-b00c-4d11-97bd-768dbd35c35d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36532025-03-25T01:22:01.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bece1b10-b00c-4d11-97bd-768dbd35c35d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36542025-03-25T01:22:01.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1834 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bece1b10-b00c-4d11-97bd-768dbd35c35d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
36552025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
36562025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
36572025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
36582025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
36592025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
36602025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
36612025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
36622025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
36632025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
36642025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
36652025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
36662025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
36672025-03-25T01:22:01.732ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
36682025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
36692025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
36702025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
36712025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
36722025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 6 reason = Timeout
36732025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
36742025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
36752025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
36762025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
36772025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
36782025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
36792025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
36802025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
36812025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
36822025-03-25T01:22:01.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
36832025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
36842025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
36852025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
36862025-03-25T01:22:01.734ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
36872025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
36882025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
36892025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36902025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 6 reason = Timeout
36912025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
36922025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
36932025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
36942025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
36952025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
36962025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
36972025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
36982025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
36992025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
37002025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37012025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
37022025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37032025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
37042025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37052025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37062025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37072025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37082025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
37092025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
37102025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37112025-03-25T01:22:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37122025-03-25T01:22:01.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37132025-03-25T01:22:01.736ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.895826ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
37142025-03-25T01:22:01.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1025, tv_nsec: 454296048 } })
37152025-03-25T01:22:01.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
37162025-03-25T01:22:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
37172025-03-25T01:22:01.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
37182025-03-25T01:22:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
37192025-03-25T01:22:01.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37202025-03-25T01:22:01.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37212025-03-25T01:22:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
37222025-03-25T01:22:01.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37232025-03-25T01:22:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37242025-03-25T01:22:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37252025-03-25T01:22:01.741ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37262025-03-25T01:22:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37272025-03-25T01:22:01.746ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37282025-03-25T01:22:01.746ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37292025-03-25T01:22:01.746ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1025, tv_nsec: 464105698 } })
37302025-03-25T01:22:01.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
37312025-03-25T01:22:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37322025-03-25T01:22:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
37332025-03-25T01:22:01.748ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
37342025-03-25T01:22:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
37352025-03-25T01:22:01.759ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
37362025-03-25T01:22:01.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
37372025-03-25T01:22:01.762ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1025, tv_nsec: 479672091 } })
37382025-03-25T01:22:01.762ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
37392025-03-25T01:22:01.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37402025-03-25T01:22:01.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37412025-03-25T01:22:01.767ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37422025-03-25T01:22:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
37432025-03-25T01:22:01.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
37442025-03-25T01:22:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
37452025-03-25T01:22:01.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37462025-03-25T01:22:01.801ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
37472025-03-25T01:22:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
37482025-03-25T01:22:01.802ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 67.948822ms iteration = 6 status = {"errors":[],"finish_invoked_ok":[]}
37492025-03-25T01:22:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
37502025-03-25T01:22:01.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37512025-03-25T01:22:01.804ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 71.634745ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
37522025-03-25T01:22:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37532025-03-25T01:22:01.808ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37542025-03-25T01:22:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37552025-03-25T01:22:01.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.019031ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
37562025-03-25T01:22:01.815ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37572025-03-25T01:22:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 83.392194ms iteration = 6 status = {"errors":[],"requests_created_ok":[]}
37582025-03-25T01:22:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37592025-03-25T01:22:01.818ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37602025-03-25T01:22:01.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37612025-03-25T01:22:01.820ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
37622025-03-25T01:22:01.820ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
37632025-03-25T01:22:01.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
37642025-03-25T01:22:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
37652025-03-25T01:22:01.821ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37662025-03-25T01:22:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37672025-03-25T01:22:01.822ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37682025-03-25T01:22:01.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37692025-03-25T01:22:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
37702025-03-25T01:22:01.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
37712025-03-25T01:22:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
37722025-03-25T01:22:01.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37732025-03-25T01:22:01.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37742025-03-25T01:22:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37752025-03-25T01:22:01.828ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
37762025-03-25T01:22:01.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
37772025-03-25T01:22:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
37782025-03-25T01:22:01.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
37792025-03-25T01:22:01.830ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
37802025-03-25T01:22:01.830ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 97.312333ms iteration = 6 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
37812025-03-25T01:22:01.830ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37822025-03-25T01:22:01.831ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 97.010468ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
37832025-03-25T01:22:01.832ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
37842025-03-25T01:22:01.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37852025-03-25T01:22:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37862025-03-25T01:22:01.835ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
37872025-03-25T01:22:01.835ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
37882025-03-25T01:22:01.835ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b771ead1-7828-4c5d-91ac-47a5d659b33a", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
37892025-03-25T01:22:01.835ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
37902025-03-25T01:22:01.837ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
37912025-03-25T01:22:01.837ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
37922025-03-25T01:22:01.837ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 103.602132ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
37932025-03-25T01:22:01.840ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
37942025-03-25T01:22:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
37952025-03-25T01:22:01.843ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37962025-03-25T01:22:01.844ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
37972025-03-25T01:22:01.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
37982025-03-25T01:22:01.846ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
37992025-03-25T01:22:01.846ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38002025-03-25T01:22:01.846ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bcfb5c39-03e9-4eeb-923f-10c517e727ab", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38012025-03-25T01:22:01.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38022025-03-25T01:22:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
38032025-03-25T01:22:01.847ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38042025-03-25T01:22:01.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
38052025-03-25T01:22:01.847ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
38062025-03-25T01:22:01.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38072025-03-25T01:22:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38082025-03-25T01:22:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38092025-03-25T01:22:01.847ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c141f20-3153-45ba-bb9c-bd6ea6f7f994", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38102025-03-25T01:22:01.847ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
38112025-03-25T01:22:01.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
38122025-03-25T01:22:01.849ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38132025-03-25T01:22:01.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
38142025-03-25T01:22:01.849ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 116.7653ms iteration = 8 status = {"physical_disks_added":0}
38152025-03-25T01:22:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
38162025-03-25T01:22:01.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
38172025-03-25T01:22:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
38182025-03-25T01:22:01.857ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 124.300069ms iteration = 6 status = 0
38192025-03-25T01:22:01.859ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
38202025-03-25T01:22:01.859ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 126.169886ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
38212025-03-25T01:22:01.870ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38222025-03-25T01:22:01.871ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
38232025-03-25T01:22:01.871ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
38242025-03-25T01:22:01.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
38252025-03-25T01:22:01.887ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 153.06764ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
38262025-03-25T01:22:01.890ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 156.56438ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
38272025-03-25T01:22:01.903ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38282025-03-25T01:22:01.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38292025-03-25T01:22:01.914ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 181.66934ms iteration = 6 status = {}
38302025-03-25T01:22:01.920ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
38312025-03-25T01:22:01.920ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
38322025-03-25T01:22:01.920ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.022341ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
38332025-03-25T01:22:01.935ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
38342025-03-25T01:22:01.935ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f529f3b-0667-4134-aa1d-a6ea1d70698a", "content-length": "1", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38352025-03-25T01:22:01.936ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
38362025-03-25T01:22:01.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
38372025-03-25T01:22:01.938ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38382025-03-25T01:22:01.938ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38392025-03-25T01:22:01.939ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 206.209241ms iteration = 6 status = null
38402025-03-25T01:22:01.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38412025-03-25T01:22:01.942ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38422025-03-25T01:22:01.942ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38432025-03-25T01:22:01.942ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38442025-03-25T01:22:01.944ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38452025-03-25T01:22:01.945ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
38462025-03-25T01:22:01.945ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
38472025-03-25T01:22:01.946ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
38482025-03-25T01:22:01.967ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
38492025-03-25T01:22:01.967ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38502025-03-25T01:22:01.967ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28c4037-eac8-4461-8e58-e71bad28f9c5", "content-length": "372", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38512025-03-25T01:22:01.967ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38522025-03-25T01:22:01.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38532025-03-25T01:22:01.981ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
38542025-03-25T01:22:01.981ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
38552025-03-25T01:22:01.981ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b026ca8c-03b8-413e-9781-a49ce87335dc", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38562025-03-25T01:22:01.981ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38572025-03-25T01:22:01.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38582025-03-25T01:22:01.983ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38592025-03-25T01:22:01.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38602025-03-25T01:22:01.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
38612025-03-25T01:22:01.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
38622025-03-25T01:22:01.989ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
38632025-03-25T01:22:01.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38642025-03-25T01:22:01.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "d907b7c8-eeec-4356-8146-5415bba1ab8d", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38652025-03-25T01:22:01.990ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 256.732724ms iteration = 6 status = {}
38662025-03-25T01:22:02.000ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38672025-03-25T01:22:02.000ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38682025-03-25T01:22:02.001ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
38692025-03-25T01:22:02.002ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38702025-03-25T01:22:02.002ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38712025-03-25T01:22:02.014ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
38722025-03-25T01:22:02.015ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef684f30-aa17-43d9-9e0b-610f54f847d2", "content-length": "134", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38732025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
38742025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
38752025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
38762025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
38772025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38782025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38792025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38802025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38812025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
38822025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
38832025-03-25T01:22:02.015ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
38842025-03-25T01:22:02.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
38852025-03-25T01:22:02.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
38862025-03-25T01:22:02.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
38872025-03-25T01:22:02.018ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ead96658-482b-4a9b-b265-37174cc48ad7", "content-length": "2", "date": "Tue, 25 Mar 2025 01:22:02 GMT"} })
38882025-03-25T01:22:02.018ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
38892025-03-25T01:22:02.019ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "05446d87-871c-4da9-a340-90e0b0835662", "content-length": "51", "date": "Tue, 25 Mar 2025 01:22:02 GMT"} })
38902025-03-25T01:22:02.019ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
38912025-03-25T01:22:02.019ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
38922025-03-25T01:22:02.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
38932025-03-25T01:22:02.161ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "49fa8f9b-c2a8-42f2-8c1b-3b1c3d4a64e1", "date": "Tue, 25 Mar 2025 01:22:01 GMT"} })
38942025-03-25T01:22:02.161ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
38952025-03-25T01:22:02.161ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
38962025-03-25T01:22:02.166ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "975ea70e-ff33-4fd8-94f7-4ecfc1714aba", "content-length": "691", "date": "Tue, 25 Mar 2025 01:22:02 GMT"} })
38972025-03-25T01:22:02.166ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
38982025-03-25T01:22:02.166ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
38992025-03-25T01:22:02.166ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
39002025-03-25T01:22:02.166ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc722681-24c3-44bf-867e-c0b55dff2678", "content-length": "682", "date": "Tue, 25 Mar 2025 01:22:02 GMT"} })
39012025-03-25T01:22:02.166ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39022025-03-25T01:22:02.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39032025-03-25T01:22:02.167ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 434.562388ms iteration = 6 status = {}
39042025-03-25T01:22:02.171ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39052025-03-25T01:22:02.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39062025-03-25T01:22:02.174ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39072025-03-25T01:22:02.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39082025-03-25T01:22:02.176ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39092025-03-25T01:22:02.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39102025-03-25T01:22:02.191ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 458.4715ms iteration = 6 status = {}
39112025-03-25T01:22:02.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6c8ef605-2843-4044-8a70-e97650749c8f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39122025-03-25T01:22:02.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6c8ef605-2843-4044-8a70-e97650749c8f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39132025-03-25T01:22:02.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1914 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6c8ef605-2843-4044-8a70-e97650749c8f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39142025-03-25T01:22:03.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d04a66f-58b1-4d80-84cc-993718017475 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39152025-03-25T01:22:03.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d04a66f-58b1-4d80-84cc-993718017475 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39162025-03-25T01:22:03.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1601 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d04a66f-58b1-4d80-84cc-993718017475 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39172025-03-25T01:22:04.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c153654e-4c50-450b-a933-d1807c2f7564 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39182025-03-25T01:22:04.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c153654e-4c50-450b-a933-d1807c2f7564 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39192025-03-25T01:22:04.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c153654e-4c50-450b-a933-d1807c2f7564 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39202025-03-25T01:22:05.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 764f1e15-3fee-4930-8b91-7104ef9c5931 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39212025-03-25T01:22:05.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 764f1e15-3fee-4930-8b91-7104ef9c5931 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39222025-03-25T01:22:05.392ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1912 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 764f1e15-3fee-4930-8b91-7104ef9c5931 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39232025-03-25T01:22:05.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 575 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 718e502f-7d34-41ae-b83a-954d7111554f response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
39242025-03-25T01:22:06.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a763e4c-d703-423f-ac8c-9ebe52968f1c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39252025-03-25T01:22:06.414ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a763e4c-d703-423f-ac8c-9ebe52968f1c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39262025-03-25T01:22:06.416ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a763e4c-d703-423f-ac8c-9ebe52968f1c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39272025-03-25T01:22:07.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 621fcac7-857d-4d3f-9c7a-4abdee8a51ce roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39282025-03-25T01:22:07.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 621fcac7-857d-4d3f-9c7a-4abdee8a51ce resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39292025-03-25T01:22:07.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 621fcac7-857d-4d3f-9c7a-4abdee8a51ce response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39302025-03-25T01:22:08.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a566be5b-bb1b-486b-89c5-60c7aa37f410 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39312025-03-25T01:22:08.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a566be5b-bb1b-486b-89c5-60c7aa37f410 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39322025-03-25T01:22:08.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1823 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a566be5b-bb1b-486b-89c5-60c7aa37f410 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39332025-03-25T01:22:09.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b74b555-a242-4fe1-9343-42441cfb793c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39342025-03-25T01:22:09.480ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b74b555-a242-4fe1-9343-42441cfb793c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39352025-03-25T01:22:09.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2415 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3b74b555-a242-4fe1-9343-42441cfb793c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39362025-03-25T01:22:10.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dad32973-ab19-4a18-b816-a4f8c68971ce roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39372025-03-25T01:22:10.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dad32973-ab19-4a18-b816-a4f8c68971ce resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39382025-03-25T01:22:10.503ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2299 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dad32973-ab19-4a18-b816-a4f8c68971ce response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39392025-03-25T01:22:11.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5f2d4b4-de10-47c8-b307-c59fc1be436d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39402025-03-25T01:22:11.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5f2d4b4-de10-47c8-b307-c59fc1be436d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39412025-03-25T01:22:11.525ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5f2d4b4-de10-47c8-b307-c59fc1be436d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39422025-03-25T01:22:11.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
39432025-03-25T01:22:11.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39442025-03-25T01:22:11.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39452025-03-25T01:22:11.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
39462025-03-25T01:22:11.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39472025-03-25T01:22:11.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39482025-03-25T01:22:11.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39492025-03-25T01:22:11.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39502025-03-25T01:22:11.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39512025-03-25T01:22:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
39522025-03-25T01:22:11.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39532025-03-25T01:22:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39542025-03-25T01:22:11.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.103934ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
39552025-03-25T01:22:11.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39562025-03-25T01:22:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39572025-03-25T01:22:11.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39582025-03-25T01:22:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
39592025-03-25T01:22:11.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39602025-03-25T01:22:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39612025-03-25T01:22:11.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
39622025-03-25T01:22:11.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.308829ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
39632025-03-25T01:22:12.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5784533c-86de-485e-82c9-174aa2679323 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39642025-03-25T01:22:12.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5784533c-86de-485e-82c9-174aa2679323 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39652025-03-25T01:22:12.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5784533c-86de-485e-82c9-174aa2679323 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39662025-03-25T01:22:13.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 03a17713-4a60-4afe-a3a0-6ee6055f5958 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39672025-03-25T01:22:13.568ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 03a17713-4a60-4afe-a3a0-6ee6055f5958 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39682025-03-25T01:22:13.570ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2434 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 03a17713-4a60-4afe-a3a0-6ee6055f5958 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39692025-03-25T01:22:14.591ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 026b9323-db6a-434b-9a49-d4ec0672bec6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39702025-03-25T01:22:14.591ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 026b9323-db6a-434b-9a49-d4ec0672bec6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39712025-03-25T01:22:14.593ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2206 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 026b9323-db6a-434b-9a49-d4ec0672bec6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39722025-03-25T01:22:15.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c5496df-8dcb-4372-8539-3ca9f2381948 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39732025-03-25T01:22:15.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c5496df-8dcb-4372-8539-3ca9f2381948 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39742025-03-25T01:22:15.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c5496df-8dcb-4372-8539-3ca9f2381948 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39752025-03-25T01:22:15.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 0f28360a-0998-4b43-96be-8827035dac0d response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
39762025-03-25T01:22:16.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dca4853-eeed-421e-b47e-462f179e1a2c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39772025-03-25T01:22:16.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dca4853-eeed-421e-b47e-462f179e1a2c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39782025-03-25T01:22:16.637ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dca4853-eeed-421e-b47e-462f179e1a2c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39792025-03-25T01:22:17.660ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf5fb3e5-26c3-47aa-8cb1-28587c42b72a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39802025-03-25T01:22:17.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf5fb3e5-26c3-47aa-8cb1-28587c42b72a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39812025-03-25T01:22:17.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1720 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf5fb3e5-26c3-47aa-8cb1-28587c42b72a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39822025-03-25T01:22:18.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 249e2d15-b74b-436f-afeb-b406320f7a06 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39832025-03-25T01:22:18.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 249e2d15-b74b-436f-afeb-b406320f7a06 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39842025-03-25T01:22:18.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 249e2d15-b74b-436f-afeb-b406320f7a06 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39852025-03-25T01:22:19.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be7c281-c927-4fb4-a0ff-8d06fbb7dde5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39862025-03-25T01:22:19.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be7c281-c927-4fb4-a0ff-8d06fbb7dde5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39872025-03-25T01:22:19.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2510 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be7c281-c927-4fb4-a0ff-8d06fbb7dde5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39882025-03-25T01:22:20.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c32d3710-8c36-45ce-ad2c-849737b52ea4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39892025-03-25T01:22:20.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c32d3710-8c36-45ce-ad2c-849737b52ea4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39902025-03-25T01:22:20.731ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c32d3710-8c36-45ce-ad2c-849737b52ea4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
39912025-03-25T01:22:21.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
39922025-03-25T01:22:21.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39932025-03-25T01:22:21.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39942025-03-25T01:22:21.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
39952025-03-25T01:22:21.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39962025-03-25T01:22:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39972025-03-25T01:22:21.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39982025-03-25T01:22:21.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39992025-03-25T01:22:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40002025-03-25T01:22:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40012025-03-25T01:22:21.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40022025-03-25T01:22:21.737ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.478239ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40032025-03-25T01:22:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40042025-03-25T01:22:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40052025-03-25T01:22:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40062025-03-25T01:22:21.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40072025-03-25T01:22:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
40082025-03-25T01:22:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40092025-03-25T01:22:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40102025-03-25T01:22:21.749ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
40112025-03-25T01:22:21.749ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.511686ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
40122025-03-25T01:22:21.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 86de42dc-aa0e-4158-b4dc-736eb376988c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40132025-03-25T01:22:21.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 86de42dc-aa0e-4158-b4dc-736eb376988c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40142025-03-25T01:22:21.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 86de42dc-aa0e-4158-b4dc-736eb376988c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40152025-03-25T01:22:22.773ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4de35409-b068-4a4d-b53d-814cae55c125 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40162025-03-25T01:22:22.773ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4de35409-b068-4a4d-b53d-814cae55c125 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40172025-03-25T01:22:22.775ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4de35409-b068-4a4d-b53d-814cae55c125 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40182025-03-25T01:22:23.800ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8efaa690-ed98-42e6-821f-81aa60ea9565 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40192025-03-25T01:22:23.801ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8efaa690-ed98-42e6-821f-81aa60ea9565 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40202025-03-25T01:22:23.803ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8efaa690-ed98-42e6-821f-81aa60ea9565 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40212025-03-25T01:22:24.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c00e6a43-a3f8-4111-890d-07676aef0c7e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40222025-03-25T01:22:24.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c00e6a43-a3f8-4111-890d-07676aef0c7e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40232025-03-25T01:22:24.826ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2297 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c00e6a43-a3f8-4111-890d-07676aef0c7e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40242025-03-25T01:22:25.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 659 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 07a690e1-4e06-419a-901a-f81f2e87f391 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
40252025-03-25T01:22:25.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0d9dedea-cf68-4d16-8ac7-e9caab4a6d13 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40262025-03-25T01:22:25.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0d9dedea-cf68-4d16-8ac7-e9caab4a6d13 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40272025-03-25T01:22:25.848ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0d9dedea-cf68-4d16-8ac7-e9caab4a6d13 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40282025-03-25T01:22:26.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be235a1-344f-4307-b820-ff80ae4bb34f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40292025-03-25T01:22:26.869ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be235a1-344f-4307-b820-ff80ae4bb34f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40302025-03-25T01:22:26.871ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0be235a1-344f-4307-b820-ff80ae4bb34f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40312025-03-25T01:22:27.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 286985e9-063a-4e84-8faa-271a900e5fc5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40322025-03-25T01:22:27.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 286985e9-063a-4e84-8faa-271a900e5fc5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40332025-03-25T01:22:27.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 286985e9-063a-4e84-8faa-271a900e5fc5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40342025-03-25T01:22:28.913ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44f06e08-3de3-47c8-8057-da81109cc52f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40352025-03-25T01:22:28.914ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44f06e08-3de3-47c8-8057-da81109cc52f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40362025-03-25T01:22:28.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2860 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44f06e08-3de3-47c8-8057-da81109cc52f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40372025-03-25T01:22:29.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 466c7cf0-5fb5-463f-950c-6af75cbd7c27 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40382025-03-25T01:22:29.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 466c7cf0-5fb5-463f-950c-6af75cbd7c27 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40392025-03-25T01:22:29.937ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 466c7cf0-5fb5-463f-950c-6af75cbd7c27 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40402025-03-25T01:22:30.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32a493f5-23f6-4b6a-b5e7-e509a0fb6a0d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40412025-03-25T01:22:30.956ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32a493f5-23f6-4b6a-b5e7-e509a0fb6a0d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40422025-03-25T01:22:30.958ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2144 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32a493f5-23f6-4b6a-b5e7-e509a0fb6a0d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
40432025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
40442025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
40452025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40462025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
40472025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40482025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
40492025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
40502025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
40512025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
40522025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
40532025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
40542025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
40552025-03-25T01:22:31.733ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
40562025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
40572025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
40582025-03-25T01:22:31.733ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:12:31.733723222 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
40592025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
40602025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
40612025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
40622025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
40632025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
40642025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
40652025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
40662025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
40672025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40682025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
40692025-03-25T01:22:31.733ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
40702025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
40712025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.62\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
40722025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40732025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
40742025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
40752025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
40762025-03-25T01:22:31.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40772025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
40782025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
40792025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
40802025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
40812025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
40822025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40832025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 7 reason = Timeout
40842025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
40852025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
40862025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40872025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40882025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
40892025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
40902025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
40912025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40922025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40932025-03-25T01:22:31.734ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
40942025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
40952025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 7 reason = Timeout
40962025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
40972025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
40982025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
40992025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
41002025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
41012025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41022025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
41032025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
41042025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
41052025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41062025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
41072025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
41082025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
41092025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
41102025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
41112025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41122025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
41132025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41142025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
41152025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
41162025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
41172025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
41182025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
41192025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
41202025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
41212025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
41222025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
41232025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41242025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41252025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
41262025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41272025-03-25T01:22:31.734ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 451417627 } })
41282025-03-25T01:22:31.734ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 451416017 } })
41292025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
41302025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
41312025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
41322025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
41332025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
41342025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
41352025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
41362025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
41372025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41382025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41392025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41402025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
41412025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
41422025-03-25T01:22:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41432025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41442025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41452025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
41462025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.471871ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
41472025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
41482025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.631003ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
41492025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41502025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41512025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
41522025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41532025-03-25T01:22:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
41542025-03-25T01:22:31.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41552025-03-25T01:22:31.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41562025-03-25T01:22:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.972947ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
41572025-03-25T01:22:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
41582025-03-25T01:22:31.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41592025-03-25T01:22:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41602025-03-25T01:22:31.739ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
41612025-03-25T01:22:31.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
41622025-03-25T01:22:31.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
41632025-03-25T01:22:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
41642025-03-25T01:22:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
41652025-03-25T01:22:31.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41662025-03-25T01:22:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
41672025-03-25T01:22:31.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41682025-03-25T01:22:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
41692025-03-25T01:22:31.742ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:12:31.733723222 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
41702025-03-25T01:22:31.742ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.471161ms iteration = 4 status = {"expiration":"2025-03-25T01:12:31.733723222Z","pruned":[]}
41712025-03-25T01:22:31.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 459272269 } })
41722025-03-25T01:22:31.742ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
41732025-03-25T01:22:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
41742025-03-25T01:22:31.742ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
41752025-03-25T01:22:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
41762025-03-25T01:22:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
41772025-03-25T01:22:31.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41782025-03-25T01:22:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41792025-03-25T01:22:31.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41802025-03-25T01:22:31.746ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41812025-03-25T01:22:31.747ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41822025-03-25T01:22:31.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 464246400 } })
41832025-03-25T01:22:31.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
41842025-03-25T01:22:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41852025-03-25T01:22:31.748ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41862025-03-25T01:22:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41872025-03-25T01:22:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
41882025-03-25T01:22:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
41892025-03-25T01:22:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
41902025-03-25T01:22:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
41912025-03-25T01:22:31.750ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
41922025-03-25T01:22:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
41932025-03-25T01:22:31.754ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.108337ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
41942025-03-25T01:22:31.756ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41952025-03-25T01:22:31.756ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
41962025-03-25T01:22:31.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
41972025-03-25T01:22:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
41982025-03-25T01:22:31.758ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41992025-03-25T01:22:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42002025-03-25T01:22:31.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42012025-03-25T01:22:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42022025-03-25T01:22:31.768ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42032025-03-25T01:22:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42042025-03-25T01:22:31.774ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1055, tv_nsec: 491085824 } })
42052025-03-25T01:22:31.774ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
42062025-03-25T01:22:31.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42072025-03-25T01:22:31.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42082025-03-25T01:22:31.790ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42092025-03-25T01:22:31.791ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42102025-03-25T01:22:31.791ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42112025-03-25T01:22:31.793ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
42122025-03-25T01:22:31.793ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42132025-03-25T01:22:31.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
42142025-03-25T01:22:31.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42152025-03-25T01:22:31.800ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42162025-03-25T01:22:31.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
42172025-03-25T01:22:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
42182025-03-25T01:22:31.802ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42192025-03-25T01:22:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
42202025-03-25T01:22:31.810ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42212025-03-25T01:22:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42222025-03-25T01:22:31.811ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
42232025-03-25T01:22:31.811ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
42242025-03-25T01:22:31.811ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.295786ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
42252025-03-25T01:22:31.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 81.957803ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
42262025-03-25T01:22:31.817ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42272025-03-25T01:22:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42282025-03-25T01:22:31.820ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42292025-03-25T01:22:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42302025-03-25T01:22:31.823ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42312025-03-25T01:22:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42322025-03-25T01:22:31.824ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42332025-03-25T01:22:31.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42342025-03-25T01:22:31.826ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 91.771433ms iteration = 7 status = {"errors":[],"finish_invoked_ok":[]}
42352025-03-25T01:22:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42362025-03-25T01:22:31.827ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42372025-03-25T01:22:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42382025-03-25T01:22:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
42392025-03-25T01:22:31.829ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42402025-03-25T01:22:31.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42412025-03-25T01:22:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
42422025-03-25T01:22:31.832ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42432025-03-25T01:22:31.834ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 100.024721ms iteration = 7 status = {"errors":[],"requests_created_ok":[]}
42442025-03-25T01:22:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
42452025-03-25T01:22:31.834ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42462025-03-25T01:22:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
42472025-03-25T01:22:31.835ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42482025-03-25T01:22:31.835ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42492025-03-25T01:22:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42502025-03-25T01:22:31.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
42512025-03-25T01:22:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
42522025-03-25T01:22:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42532025-03-25T01:22:31.839ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42542025-03-25T01:22:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
42552025-03-25T01:22:31.839ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42562025-03-25T01:22:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
42572025-03-25T01:22:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42582025-03-25T01:22:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
42592025-03-25T01:22:31.842ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42602025-03-25T01:22:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42612025-03-25T01:22:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42622025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42632025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
42642025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42652025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
42662025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
42672025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42682025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
42692025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
42702025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
42712025-03-25T01:22:31.850ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42722025-03-25T01:22:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42732025-03-25T01:22:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42742025-03-25T01:22:31.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 118.617717ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
42752025-03-25T01:22:31.853ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42762025-03-25T01:22:31.853ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42772025-03-25T01:22:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42782025-03-25T01:22:31.853ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42792025-03-25T01:22:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42802025-03-25T01:22:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42812025-03-25T01:22:31.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42822025-03-25T01:22:31.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42832025-03-25T01:22:31.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
42842025-03-25T01:22:31.860ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42852025-03-25T01:22:31.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42862025-03-25T01:22:31.863ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
42872025-03-25T01:22:31.863ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
42882025-03-25T01:22:31.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
42892025-03-25T01:22:31.866ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42902025-03-25T01:22:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
42912025-03-25T01:22:31.866ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 132.77166ms iteration = 3 status = {"nsuccess":5}
42922025-03-25T01:22:31.866ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
42932025-03-25T01:22:31.866ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 132.863482ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
42942025-03-25T01:22:31.868ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42952025-03-25T01:22:31.868ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
42962025-03-25T01:22:31.868ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
42972025-03-25T01:22:31.868ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42982025-03-25T01:22:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
42992025-03-25T01:22:31.870ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43002025-03-25T01:22:31.871ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43012025-03-25T01:22:31.871ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43022025-03-25T01:22:31.871ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43032025-03-25T01:22:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43042025-03-25T01:22:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43052025-03-25T01:22:31.873ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43062025-03-25T01:22:31.874ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43072025-03-25T01:22:31.875ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
43082025-03-25T01:22:31.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43092025-03-25T01:22:31.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43102025-03-25T01:22:31.877ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
43112025-03-25T01:22:31.877ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43122025-03-25T01:22:31.878ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43132025-03-25T01:22:31.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43142025-03-25T01:22:31.878ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43152025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
43162025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
43172025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43182025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
43192025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
43202025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
43212025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
43222025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
43232025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
43242025-03-25T01:22:31.882ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 148.86331ms iteration = 4 status = {"generation":2}
43252025-03-25T01:22:31.883ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43262025-03-25T01:22:31.886ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
43272025-03-25T01:22:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
43282025-03-25T01:22:31.886ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43292025-03-25T01:22:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43302025-03-25T01:22:31.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43312025-03-25T01:22:31.896ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 163.055883ms iteration = 7 status = 0
43322025-03-25T01:22:31.897ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43332025-03-25T01:22:31.897ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
43342025-03-25T01:22:31.897ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
43352025-03-25T01:22:31.897ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43362025-03-25T01:22:31.898ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 164.21578ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
43372025-03-25T01:22:31.898ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
43382025-03-25T01:22:31.898ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
43392025-03-25T01:22:31.898ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 165.134913ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
43402025-03-25T01:22:31.900ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
43412025-03-25T01:22:31.900ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
43422025-03-25T01:22:31.900ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 165.846343ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
43432025-03-25T01:22:31.902ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
43442025-03-25T01:22:31.902ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43452025-03-25T01:22:31.903ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf79449f-a220-4ed9-a547-1fb1579a22da", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
43462025-03-25T01:22:31.903ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43472025-03-25T01:22:31.903ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 169.15056ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
43482025-03-25T01:22:31.904ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43492025-03-25T01:22:31.905ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43502025-03-25T01:22:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43512025-03-25T01:22:31.908ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
43522025-03-25T01:22:31.908ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532025-03-25T01:22:31.911ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43542025-03-25T01:22:31.911ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43552025-03-25T01:22:31.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43562025-03-25T01:22:31.911ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
43572025-03-25T01:22:31.911ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 177.235566ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
43582025-03-25T01:22:31.911ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43592025-03-25T01:22:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43602025-03-25T01:22:31.921ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
43612025-03-25T01:22:31.921ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
43622025-03-25T01:22:31.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43632025-03-25T01:22:31.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
43642025-03-25T01:22:31.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43652025-03-25T01:22:31.921ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43662025-03-25T01:22:31.921ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2e6760d-228d-4baa-8751-485e1cb09c6b", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
43672025-03-25T01:22:31.921ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43682025-03-25T01:22:31.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43692025-03-25T01:22:31.923ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
43702025-03-25T01:22:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
43712025-03-25T01:22:31.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43722025-03-25T01:22:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43732025-03-25T01:22:31.929ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
43742025-03-25T01:22:31.929ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
43752025-03-25T01:22:31.930ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
43762025-03-25T01:22:31.930ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 196.326819ms iteration = 4 status = {"generation":1}
43772025-03-25T01:22:31.934ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
43782025-03-25T01:22:31.934ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 200.122964ms iteration = 7 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
43792025-03-25T01:22:31.944ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
43802025-03-25T01:22:31.944ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
43812025-03-25T01:22:31.944ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aecaf2d2-a6e5-4f85-87ba-0033d336bc0d", "content-length": "26", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
43822025-03-25T01:22:31.945ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
43832025-03-25T01:22:31.947ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
43842025-03-25T01:22:31.960ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 226.4207ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
43852025-03-25T01:22:31.964ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
43862025-03-25T01:22:31.964ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 230.570389ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
43872025-03-25T01:22:31.974ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
43882025-03-25T01:22:31.974ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 239.918743ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
43892025-03-25T01:22:31.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e0410ed-42a7-4551-86d5-4d8ce027210e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
43902025-03-25T01:22:31.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e0410ed-42a7-4551-86d5-4d8ce027210e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
43912025-03-25T01:22:31.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e0410ed-42a7-4551-86d5-4d8ce027210e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
43922025-03-25T01:22:31.994ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 260.828662ms iteration = 9 status = {"physical_disks_added":0}
43932025-03-25T01:22:32.098ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
43942025-03-25T01:22:32.099ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae30e9b5-0584-4713-9555-fd64da5fe023", "content-length": "1", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
43952025-03-25T01:22:32.100ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43962025-03-25T01:22:32.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43972025-03-25T01:22:32.101ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
43982025-03-25T01:22:32.101ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2cde867a-db20-4be1-ba1e-2d8f975b5128", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
43992025-03-25T01:22:32.101ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44002025-03-25T01:22:32.103ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 369.787382ms iteration = 7 status = null
44012025-03-25T01:22:32.103ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b6d0d5cf-8d13-4696-9017-d3b229220f05", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44022025-03-25T01:22:32.103ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44032025-03-25T01:22:32.106ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
44042025-03-25T01:22:32.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 372.626483ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
44052025-03-25T01:22:32.140ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.849302ms iteration = 7 status = {}
44062025-03-25T01:22:32.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
44072025-03-25T01:22:32.264ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
44082025-03-25T01:22:32.264ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44092025-03-25T01:22:32.265ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f9724e8-c3f5-42fd-868f-c50acdcfbf0f", "content-length": "372", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
44102025-03-25T01:22:32.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44112025-03-25T01:22:32.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44122025-03-25T01:22:32.277ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
44132025-03-25T01:22:32.277ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fad5d9aa-ca30-4586-8670-10b50295885d", "content-length": "691", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
44142025-03-25T01:22:32.277ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
44152025-03-25T01:22:32.277ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
44162025-03-25T01:22:32.278ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
44172025-03-25T01:22:32.279ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 545.492405ms iteration = 7 status = {}
44182025-03-25T01:22:32.312ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
44192025-03-25T01:22:32.312ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
44202025-03-25T01:22:32.312ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "08bee6a0-ab33-4e0b-bb19-8eede2a25206", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
44212025-03-25T01:22:32.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44222025-03-25T01:22:32.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44232025-03-25T01:22:32.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44242025-03-25T01:22:32.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44252025-03-25T01:22:32.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44262025-03-25T01:22:32.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44272025-03-25T01:22:32.325ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
44282025-03-25T01:22:32.325ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
44292025-03-25T01:22:32.325ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e474e973-4ed0-4d93-b4b3-4151737d7585", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
44302025-03-25T01:22:32.327ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 592.65345ms iteration = 7 status = {}
44312025-03-25T01:22:32.378ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
44322025-03-25T01:22:32.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a02eb1a9-850a-436c-b908-53e0bdb9ede6", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44332025-03-25T01:22:32.379ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44342025-03-25T01:22:32.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "8d210ce0-76e8-4ab9-9897-96541525a73f", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44352025-03-25T01:22:32.381ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44362025-03-25T01:22:32.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "06d7b6fe-6c2a-4906-99ec-bdbfc8f99bda", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44372025-03-25T01:22:32.382ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44382025-03-25T01:22:32.383ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
44392025-03-25T01:22:32.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 650.171483ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
44402025-03-25T01:22:32.405ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44412025-03-25T01:22:32.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44422025-03-25T01:22:32.407ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
44432025-03-25T01:22:32.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44442025-03-25T01:22:32.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44452025-03-25T01:22:32.414ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
44462025-03-25T01:22:32.414ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9f707b9-9d6d-4544-abea-7b0475e24ecf", "content-length": "134", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} })
44472025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
44482025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
44492025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
44502025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
44512025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44522025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44532025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44542025-03-25T01:22:32.414ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44552025-03-25T01:22:32.415ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
44562025-03-25T01:22:32.415ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
44572025-03-25T01:22:32.415ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
44582025-03-25T01:22:32.415ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44592025-03-25T01:22:32.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44602025-03-25T01:22:32.417ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
44612025-03-25T01:22:32.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59242b75-43e8-43ad-940a-d7a1dd84fea6", "content-length": "2", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} })
44622025-03-25T01:22:32.418ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
44632025-03-25T01:22:32.418ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "358caeac-8a4b-4d6f-90bb-efb80d05cecd", "content-length": "51", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} })
44642025-03-25T01:22:32.418ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
44652025-03-25T01:22:32.418ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
44662025-03-25T01:22:32.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7b3ff5a7-81f5-4950-88c9-dd761a218369", "date": "Tue, 25 Mar 2025 01:22:31 GMT"} })
44672025-03-25T01:22:32.542ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
44682025-03-25T01:22:32.542ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
44692025-03-25T01:22:32.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b11f707a-cd46-4a23-95b7-959a67cecfc4", "content-length": "682", "date": "Tue, 25 Mar 2025 01:22:32 GMT"} })
44702025-03-25T01:22:32.542ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44712025-03-25T01:22:32.543ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44722025-03-25T01:22:32.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44732025-03-25T01:22:32.549ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44742025-03-25T01:22:32.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44752025-03-25T01:22:32.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44762025-03-25T01:22:32.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
44772025-03-25T01:22:32.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
44782025-03-25T01:22:32.561ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 827.728264ms iteration = 7 status = {}
44792025-03-25T01:22:33.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9407628a-7caa-4d71-87fc-ad0d5fa21643 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44802025-03-25T01:22:33.003ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9407628a-7caa-4d71-87fc-ad0d5fa21643 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44812025-03-25T01:22:33.005ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9407628a-7caa-4d71-87fc-ad0d5fa21643 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44822025-03-25T01:22:34.026ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d45bbe11-a645-4104-9018-1a33cf9ce5bc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44832025-03-25T01:22:34.026ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d45bbe11-a645-4104-9018-1a33cf9ce5bc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44842025-03-25T01:22:34.028ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2337 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d45bbe11-a645-4104-9018-1a33cf9ce5bc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44852025-03-25T01:22:35.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c96814b4-25cb-4d71-9164-75a13a0f626f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44862025-03-25T01:22:35.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c96814b4-25cb-4d71-9164-75a13a0f626f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44872025-03-25T01:22:35.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2083 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c96814b4-25cb-4d71-9164-75a13a0f626f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44882025-03-25T01:22:35.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 845 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 9e0c17f0-1b0b-4027-9793-97d0167db2fb response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
44892025-03-25T01:22:36.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c970054-fc1b-41e0-831f-06f20cd0b0d2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44902025-03-25T01:22:36.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c970054-fc1b-41e0-831f-06f20cd0b0d2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44912025-03-25T01:22:36.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2588 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c970054-fc1b-41e0-831f-06f20cd0b0d2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44922025-03-25T01:22:37.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e7aafd5-3f76-471c-9aca-f793bd12a83f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44932025-03-25T01:22:37.097ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e7aafd5-3f76-471c-9aca-f793bd12a83f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44942025-03-25T01:22:37.099ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2506 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e7aafd5-3f76-471c-9aca-f793bd12a83f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44952025-03-25T01:22:38.120ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d8728b60-10a1-422b-a8f6-c99cbf44f3ce roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44962025-03-25T01:22:38.121ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d8728b60-10a1-422b-a8f6-c99cbf44f3ce resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44972025-03-25T01:22:38.123ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2301 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d8728b60-10a1-422b-a8f6-c99cbf44f3ce response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44982025-03-25T01:22:39.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 745ccfae-8b1b-48da-ad76-015c88804f51 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
44992025-03-25T01:22:39.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 745ccfae-8b1b-48da-ad76-015c88804f51 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45002025-03-25T01:22:39.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2250 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 745ccfae-8b1b-48da-ad76-015c88804f51 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45012025-03-25T01:22:40.166ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5abd622-a2b9-46d7-a8d7-5d42a68b0cca roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45022025-03-25T01:22:40.167ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5abd622-a2b9-46d7-a8d7-5d42a68b0cca resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45032025-03-25T01:22:40.168ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2033 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f5abd622-a2b9-46d7-a8d7-5d42a68b0cca response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45042025-03-25T01:22:41.189ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b45376c5-9a2e-4acf-9953-523798e357da roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45052025-03-25T01:22:41.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b45376c5-9a2e-4acf-9953-523798e357da resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45062025-03-25T01:22:41.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2440 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b45376c5-9a2e-4acf-9953-523798e357da response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45072025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
45082025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45092025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45102025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
45112025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45122025-03-25T01:22:41.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45132025-03-25T01:22:41.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45142025-03-25T01:22:41.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45152025-03-25T01:22:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45162025-03-25T01:22:41.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.807584ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45172025-03-25T01:22:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45182025-03-25T01:22:41.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45192025-03-25T01:22:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45202025-03-25T01:22:41.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45212025-03-25T01:22:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45222025-03-25T01:22:41.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45232025-03-25T01:22:41.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
45242025-03-25T01:22:41.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45252025-03-25T01:22:41.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45262025-03-25T01:22:41.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
45272025-03-25T01:22:41.751ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.022224ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
45282025-03-25T01:22:42.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d781c3b-1adf-415e-9ee4-a5034bc9acf6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45292025-03-25T01:22:42.212ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d781c3b-1adf-415e-9ee4-a5034bc9acf6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45302025-03-25T01:22:42.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1909 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d781c3b-1adf-415e-9ee4-a5034bc9acf6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45312025-03-25T01:22:43.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a8f965d-628c-49f8-89ee-e396c996751b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45322025-03-25T01:22:43.235ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a8f965d-628c-49f8-89ee-e396c996751b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45332025-03-25T01:22:43.237ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5a8f965d-628c-49f8-89ee-e396c996751b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45342025-03-25T01:22:44.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d0bb295-b10f-401f-91c8-505b2ab8adbe roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45352025-03-25T01:22:44.258ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d0bb295-b10f-401f-91c8-505b2ab8adbe resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45362025-03-25T01:22:44.259ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d0bb295-b10f-401f-91c8-505b2ab8adbe response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45372025-03-25T01:22:45.279ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a057577c-8f08-42da-8875-dd573066b71f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45382025-03-25T01:22:45.279ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a057577c-8f08-42da-8875-dd573066b71f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45392025-03-25T01:22:45.281ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2285 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a057577c-8f08-42da-8875-dd573066b71f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45402025-03-25T01:22:45.760ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 435 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = f1f9580d-3490-48f3-a8ca-42c2d70aa60f response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
45412025-03-25T01:22:46.301ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2e9933f3-4996-4690-83d1-381372db5cdb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45422025-03-25T01:22:46.301ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2e9933f3-4996-4690-83d1-381372db5cdb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45432025-03-25T01:22:46.303ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2248 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2e9933f3-4996-4690-83d1-381372db5cdb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45442025-03-25T01:22:47.323ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 654881ce-b249-4bf8-b3a3-69ea5da05532 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45452025-03-25T01:22:47.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 654881ce-b249-4bf8-b3a3-69ea5da05532 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45462025-03-25T01:22:47.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 654881ce-b249-4bf8-b3a3-69ea5da05532 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45472025-03-25T01:22:48.346ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b75a5b88-c9f4-4a7b-84d4-73654749066f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45482025-03-25T01:22:48.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b75a5b88-c9f4-4a7b-84d4-73654749066f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45492025-03-25T01:22:48.348ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2151 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b75a5b88-c9f4-4a7b-84d4-73654749066f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45502025-03-25T01:22:49.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a0cd3f81-3eeb-4fce-87c8-0bbacb053906 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45512025-03-25T01:22:49.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a0cd3f81-3eeb-4fce-87c8-0bbacb053906 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45522025-03-25T01:22:49.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1840 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a0cd3f81-3eeb-4fce-87c8-0bbacb053906 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45532025-03-25T01:22:50.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0460b3a-2a36-4fbe-92d5-ecfde2451bea roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45542025-03-25T01:22:50.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0460b3a-2a36-4fbe-92d5-ecfde2451bea resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45552025-03-25T01:22:50.394ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2378 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b0460b3a-2a36-4fbe-92d5-ecfde2451bea response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45562025-03-25T01:22:51.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e362717a-efa7-4e21-8336-62c0b4200c0b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45572025-03-25T01:22:51.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e362717a-efa7-4e21-8336-62c0b4200c0b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45582025-03-25T01:22:51.417ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1841 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e362717a-efa7-4e21-8336-62c0b4200c0b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45592025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
45602025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45612025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45622025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
45632025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45642025-03-25T01:22:51.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45652025-03-25T01:22:51.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45662025-03-25T01:22:51.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45672025-03-25T01:22:51.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45682025-03-25T01:22:51.738ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.871786ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
45692025-03-25T01:22:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
45702025-03-25T01:22:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45712025-03-25T01:22:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45722025-03-25T01:22:51.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45732025-03-25T01:22:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45742025-03-25T01:22:51.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45752025-03-25T01:22:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
45762025-03-25T01:22:51.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45772025-03-25T01:22:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45782025-03-25T01:22:51.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
45792025-03-25T01:22:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.121691ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
45802025-03-25T01:22:52.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b1d588f-d65d-4cd6-9eae-36eee4b1dbef roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45812025-03-25T01:22:52.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b1d588f-d65d-4cd6-9eae-36eee4b1dbef resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45822025-03-25T01:22:52.439ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b1d588f-d65d-4cd6-9eae-36eee4b1dbef response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45832025-03-25T01:22:53.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 882b6df7-423e-4c40-a266-00844c4781cc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45842025-03-25T01:22:53.460ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 882b6df7-423e-4c40-a266-00844c4781cc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45852025-03-25T01:22:53.461ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1502 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 882b6df7-423e-4c40-a266-00844c4781cc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45862025-03-25T01:22:54.481ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fee23edc-6d33-44f2-a8e4-809254f0dfe8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45872025-03-25T01:22:54.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fee23edc-6d33-44f2-a8e4-809254f0dfe8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45882025-03-25T01:22:54.483ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2147 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fee23edc-6d33-44f2-a8e4-809254f0dfe8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45892025-03-25T01:22:55.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512d3d19-47fb-4d66-a89d-89b5f95607b3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45902025-03-25T01:22:55.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512d3d19-47fb-4d66-a89d-89b5f95607b3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45912025-03-25T01:22:55.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512d3d19-47fb-4d66-a89d-89b5f95607b3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45922025-03-25T01:22:55.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 488 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = ff675f6d-5b52-415f-afd0-c5dfce10995c response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
45932025-03-25T01:22:56.525ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 927c3bb2-7e99-4f07-8044-1eb381773ff6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45942025-03-25T01:22:56.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 927c3bb2-7e99-4f07-8044-1eb381773ff6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45952025-03-25T01:22:56.527ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2424 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 927c3bb2-7e99-4f07-8044-1eb381773ff6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45962025-03-25T01:22:57.546ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44747b8d-9993-4a0b-8aef-326c8849edd8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45972025-03-25T01:22:57.547ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44747b8d-9993-4a0b-8aef-326c8849edd8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45982025-03-25T01:22:57.548ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1866 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44747b8d-9993-4a0b-8aef-326c8849edd8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
45992025-03-25T01:22:58.570ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ddd22-7cc7-4e3b-89d7-06ccce5bc06f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46002025-03-25T01:22:58.570ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ddd22-7cc7-4e3b-89d7-06ccce5bc06f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46012025-03-25T01:22:58.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac9ddd22-7cc7-4e3b-89d7-06ccce5bc06f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46022025-03-25T01:22:59.592ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a384f12e-bfa0-4781-9ef6-476733df381e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46032025-03-25T01:22:59.593ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a384f12e-bfa0-4781-9ef6-476733df381e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46042025-03-25T01:22:59.594ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2221 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a384f12e-bfa0-4781-9ef6-476733df381e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46052025-03-25T01:23:00.615ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b19dbbde-b0bb-4904-9cfe-79eddc517d8b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46062025-03-25T01:23:00.615ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b19dbbde-b0bb-4904-9cfe-79eddc517d8b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46072025-03-25T01:23:00.617ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2286 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b19dbbde-b0bb-4904-9cfe-79eddc517d8b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46082025-03-25T01:23:01.639ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3eb06ce-2fb8-4725-b6a1-67ce53648e80 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46092025-03-25T01:23:01.639ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3eb06ce-2fb8-4725-b6a1-67ce53648e80 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46102025-03-25T01:23:01.641ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2121 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3eb06ce-2fb8-4725-b6a1-67ce53648e80 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
46112025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
46122025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
46132025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
46142025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46152025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
46162025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 8 reason = Timeout
46172025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46182025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46192025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
46202025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
46212025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46222025-03-25T01:23:01.733ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
46232025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46242025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46252025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
46262025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
46272025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
46282025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
46292025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
46302025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46312025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
46322025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46332025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46342025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
46352025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46362025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46372025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
46382025-03-25T01:23:01.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46392025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
46402025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
46412025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
46422025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 8 reason = Timeout
46432025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
46442025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
46452025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
46462025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
46472025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
46482025-03-25T01:23:01.735ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
46492025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46502025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
46512025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46522025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
46532025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
46542025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
46552025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
46562025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
46572025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46582025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46592025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
46602025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
46612025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
46622025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46632025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46642025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
46652025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46662025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46672025-03-25T01:23:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
46682025-03-25T01:23:01.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46692025-03-25T01:23:01.736ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 453210773 } })
46702025-03-25T01:23:01.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46712025-03-25T01:23:01.737ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
46722025-03-25T01:23:01.738ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.014827ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46732025-03-25T01:23:01.738ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46742025-03-25T01:23:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46752025-03-25T01:23:01.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46762025-03-25T01:23:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46772025-03-25T01:23:01.738ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 455287482 } })
46782025-03-25T01:23:01.739ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
46792025-03-25T01:23:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46802025-03-25T01:23:01.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46812025-03-25T01:23:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
46822025-03-25T01:23:01.740ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
46832025-03-25T01:23:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46842025-03-25T01:23:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
46852025-03-25T01:23:01.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46862025-03-25T01:23:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46872025-03-25T01:23:01.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46882025-03-25T01:23:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46892025-03-25T01:23:01.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.940252ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
46902025-03-25T01:23:01.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46912025-03-25T01:23:01.745ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
46922025-03-25T01:23:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
46932025-03-25T01:23:01.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46942025-03-25T01:23:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46952025-03-25T01:23:01.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46962025-03-25T01:23:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46972025-03-25T01:23:01.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46982025-03-25T01:23:01.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46992025-03-25T01:23:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47002025-03-25T01:23:01.751ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47012025-03-25T01:23:01.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47022025-03-25T01:23:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47032025-03-25T01:23:01.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.963907ms iteration = 8 status = {"errors":[],"finish_invoked_ok":[]}
47042025-03-25T01:23:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47052025-03-25T01:23:01.754ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47062025-03-25T01:23:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47072025-03-25T01:23:01.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1085, tv_nsec: 472209534 } })
47082025-03-25T01:23:01.756ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
47092025-03-25T01:23:01.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 23.665998ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47102025-03-25T01:23:01.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47112025-03-25T01:23:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47122025-03-25T01:23:01.758ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47132025-03-25T01:23:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47142025-03-25T01:23:01.759ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47152025-03-25T01:23:01.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47162025-03-25T01:23:01.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47172025-03-25T01:23:01.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47182025-03-25T01:23:01.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47192025-03-25T01:23:01.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47202025-03-25T01:23:01.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47212025-03-25T01:23:01.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47222025-03-25T01:23:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47232025-03-25T01:23:01.773ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47242025-03-25T01:23:01.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47252025-03-25T01:23:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
47262025-03-25T01:23:01.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47272025-03-25T01:23:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47282025-03-25T01:23:01.799ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
47292025-03-25T01:23:01.799ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.900313ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
47302025-03-25T01:23:01.802ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47312025-03-25T01:23:01.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47322025-03-25T01:23:01.807ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47332025-03-25T01:23:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47342025-03-25T01:23:01.811ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47352025-03-25T01:23:01.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47362025-03-25T01:23:01.813ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 77.962615ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47372025-03-25T01:23:01.814ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47382025-03-25T01:23:01.814ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
47392025-03-25T01:23:01.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47402025-03-25T01:23:01.814ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 79.462057ms iteration = 8 status = {"errors":[],"requests_created_ok":[]}
47412025-03-25T01:23:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47422025-03-25T01:23:01.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47432025-03-25T01:23:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47442025-03-25T01:23:01.819ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47452025-03-25T01:23:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47462025-03-25T01:23:01.832ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47472025-03-25T01:23:01.832ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 97.396524ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47482025-03-25T01:23:01.836ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 102.369476ms iteration = 10 status = {"physical_disks_added":0}
47492025-03-25T01:23:01.879ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
47502025-03-25T01:23:01.879ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47512025-03-25T01:23:01.880ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e22cabf-6505-4e24-aeb8-a50b33a3a44d", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
47522025-03-25T01:23:01.880ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47532025-03-25T01:23:01.881ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
47542025-03-25T01:23:01.887ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47552025-03-25T01:23:01.887ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47562025-03-25T01:23:01.887ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a220b07-0a91-43b4-95a7-f3faaf546447", "content-length": "372", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
47572025-03-25T01:23:01.887ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47582025-03-25T01:23:01.888ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47592025-03-25T01:23:01.888ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 153.7284ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47602025-03-25T01:23:01.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47612025-03-25T01:23:01.890ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47622025-03-25T01:23:01.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47632025-03-25T01:23:01.891ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47642025-03-25T01:23:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
47652025-03-25T01:23:01.891ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
47662025-03-25T01:23:01.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47672025-03-25T01:23:01.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
47682025-03-25T01:23:01.893ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692025-03-25T01:23:01.893ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 158.665981ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
47702025-03-25T01:23:01.896ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
47712025-03-25T01:23:01.896ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47722025-03-25T01:23:01.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47732025-03-25T01:23:01.898ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 164.760098ms iteration = 8 status = 0
47742025-03-25T01:23:01.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
47752025-03-25T01:23:01.922ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47762025-03-25T01:23:01.923ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "999b2141-e7b0-492e-9db0-430b90a3f18e", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
47772025-03-25T01:23:01.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47782025-03-25T01:23:01.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47792025-03-25T01:23:01.929ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47802025-03-25T01:23:01.929ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47812025-03-25T01:23:01.929ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47822025-03-25T01:23:01.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47832025-03-25T01:23:01.934ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
47842025-03-25T01:23:01.934ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 200.644151ms iteration = 8 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
47852025-03-25T01:23:01.938ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
47862025-03-25T01:23:01.938ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47872025-03-25T01:23:01.939ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f378768-de28-43fd-899f-e932595fdb6d", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
47882025-03-25T01:23:01.939ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47892025-03-25T01:23:01.940ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47902025-03-25T01:23:01.941ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47912025-03-25T01:23:01.941ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47922025-03-25T01:23:01.941ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "856c2d8e-af4f-4a5b-a5f8-7093b60f85e6", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
47932025-03-25T01:23:01.941ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47942025-03-25T01:23:01.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47952025-03-25T01:23:01.944ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47962025-03-25T01:23:01.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47972025-03-25T01:23:01.947ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47982025-03-25T01:23:01.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47992025-03-25T01:23:01.950ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48002025-03-25T01:23:01.950ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48012025-03-25T01:23:01.951ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a1630da2-a1a8-4d1b-9ff3-b513939545d3", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48022025-03-25T01:23:01.953ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 218.166582ms iteration = 8 status = {}
48032025-03-25T01:23:01.966ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48042025-03-25T01:23:01.966ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48052025-03-25T01:23:01.966ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 231.440632ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48062025-03-25T01:23:01.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48072025-03-25T01:23:01.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48082025-03-25T01:23:01.995ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48092025-03-25T01:23:01.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48102025-03-25T01:23:01.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48112025-03-25T01:23:01.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48122025-03-25T01:23:02.004ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48132025-03-25T01:23:02.004ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "da0cb385-8efa-4973-8c29-ab31a0a4732d", "content-length": "1", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48142025-03-25T01:23:02.005ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48152025-03-25T01:23:02.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48162025-03-25T01:23:02.008ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 274.533018ms iteration = 8 status = null
48172025-03-25T01:23:02.020ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 286.832795ms iteration = 8 status = {}
48182025-03-25T01:23:02.038ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48192025-03-25T01:23:02.041ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48202025-03-25T01:23:02.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48212025-03-25T01:23:02.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48222025-03-25T01:23:02.072ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48232025-03-25T01:23:02.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48242025-03-25T01:23:02.076ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
48252025-03-25T01:23:02.076ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48262025-03-25T01:23:02.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48272025-03-25T01:23:02.092ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48282025-03-25T01:23:02.092ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b605f0aa-914e-4e83-b25c-8fb345e7e9e7", "content-length": "134", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48292025-03-25T01:23:02.092ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48302025-03-25T01:23:02.092ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
48312025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48322025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48332025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48342025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48352025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48362025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48372025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48382025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48392025-03-25T01:23:02.093ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
48402025-03-25T01:23:02.093ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48412025-03-25T01:23:02.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48422025-03-25T01:23:02.096ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48432025-03-25T01:23:02.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "33e9d1d9-0426-4eb3-a6b7-faa1c40163a0", "content-length": "2", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48442025-03-25T01:23:02.096ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48452025-03-25T01:23:02.096ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd211c75-61fb-4b41-83bb-162e84c79343", "content-length": "51", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48462025-03-25T01:23:02.096ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
48472025-03-25T01:23:02.096ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48482025-03-25T01:23:02.156ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48492025-03-25T01:23:02.203ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bdd29f25-ebf9-4131-b198-46a11e3a3d76", "content-length": "691", "date": "Tue, 25 Mar 2025 01:23:01 GMT"} })
48502025-03-25T01:23:02.203ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48512025-03-25T01:23:02.203ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48522025-03-25T01:23:02.203ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48532025-03-25T01:23:02.204ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.737366ms iteration = 8 status = {}
48542025-03-25T01:23:02.256ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
48552025-03-25T01:23:02.256ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
48562025-03-25T01:23:02.287ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
48572025-03-25T01:23:02.287ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:56969
48582025-03-25T01:23:02.287ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56969 req_id = dffc449d-cd9f-42cb-a868-63744d3057a8 roles = RoleSet { roles: {} } uri = /metrics/producers
48592025-03-25T01:23:02.287ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56969 req_id = dffc449d-cd9f-42cb-a868-63744d3057a8 resource = Database result = Ok(()) uri = /metrics/producers
48602025-03-25T01:23:02.308ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1571a62d-6bf1-4673-b10a-30738dd3ddca", "date": "Tue, 25 Mar 2025 01:23:02 GMT"} })
48612025-03-25T01:23:02.308ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
48622025-03-25T01:23:02.308ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48632025-03-25T01:23:02.308ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "16e150b5-53ce-4b90-95d0-02a22215ea15", "content-length": "682", "date": "Tue, 25 Mar 2025 01:23:02 GMT"} })
48642025-03-25T01:23:02.308ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48652025-03-25T01:23:02.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48662025-03-25T01:23:02.313ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48672025-03-25T01:23:02.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48682025-03-25T01:23:02.316ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48692025-03-25T01:23:02.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48702025-03-25T01:23:02.318ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48712025-03-25T01:23:02.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48722025-03-25T01:23:02.328ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 594.519427ms iteration = 8 status = {}
48732025-03-25T01:23:02.331ZINFOnexus: assigned collector to new producer collector_id = a9f260fd-b911-4f87-b07b-84934591a3eb file = nexus/src/app/oximeter.rs:76 producer_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
48742025-03-25T01:23:02.331ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 44034 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:56969 req_id = dffc449d-cd9f-42cb-a868-63744d3057a8 response_code = 201 uri = /metrics/producers
48752025-03-25T01:23:02.331ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "dffc449d-cd9f-42cb-a868-63744d3057a8", "content-length": "41", "date": "Tue, 25 Mar 2025 01:23:02 GMT"} })
48762025-03-25T01:23:02.332ZDEBGnexus (producer-registration-task): registered with nexus successfully
48772025-03-25T01:23:02.332ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
48782025-03-25T01:23:02.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 70a729b9-0ab4-46ef-96f8-c5b23674e0b1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48792025-03-25T01:23:02.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 70a729b9-0ab4-46ef-96f8-c5b23674e0b1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48802025-03-25T01:23:02.664ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2108 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 70a729b9-0ab4-46ef-96f8-c5b23674e0b1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48812025-03-25T01:23:03.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 114cbe2a-4e68-46c0-9756-c0762702f5e8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48822025-03-25T01:23:03.684ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 114cbe2a-4e68-46c0-9756-c0762702f5e8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48832025-03-25T01:23:03.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 114cbe2a-4e68-46c0-9756-c0762702f5e8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48842025-03-25T01:23:04.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57cd43dd-a230-4ae2-b3bf-00c8fcda3dff roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48852025-03-25T01:23:04.706ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57cd43dd-a230-4ae2-b3bf-00c8fcda3dff resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48862025-03-25T01:23:04.708ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1949 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 57cd43dd-a230-4ae2-b3bf-00c8fcda3dff response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48872025-03-25T01:23:05.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8545595e-a1d7-4451-8ba9-671cb06ed54c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48882025-03-25T01:23:05.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8545595e-a1d7-4451-8ba9-671cb06ed54c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48892025-03-25T01:23:05.730ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8545595e-a1d7-4451-8ba9-671cb06ed54c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48902025-03-25T01:23:05.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = e6cf0510-88c5-4ded-8e9b-c7108c63b153 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
48912025-03-25T01:23:06.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6dcaad81-c141-489c-9613-f1f154898f3d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48922025-03-25T01:23:06.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6dcaad81-c141-489c-9613-f1f154898f3d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48932025-03-25T01:23:06.752ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6dcaad81-c141-489c-9613-f1f154898f3d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48942025-03-25T01:23:07.770ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4a1647b-39f8-4e9b-960a-7975c04bd9ba roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48952025-03-25T01:23:07.771ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4a1647b-39f8-4e9b-960a-7975c04bd9ba resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48962025-03-25T01:23:07.772ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2079 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4a1647b-39f8-4e9b-960a-7975c04bd9ba response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48972025-03-25T01:23:08.793ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 53868bc7-6efe-4a78-9f66-160fab410670 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48982025-03-25T01:23:08.793ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 53868bc7-6efe-4a78-9f66-160fab410670 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
48992025-03-25T01:23:08.795ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 53868bc7-6efe-4a78-9f66-160fab410670 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49002025-03-25T01:23:09.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e462c8d-8362-49d3-a6f3-cf05dd08306b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49012025-03-25T01:23:09.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e462c8d-8362-49d3-a6f3-cf05dd08306b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49022025-03-25T01:23:09.818ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e462c8d-8362-49d3-a6f3-cf05dd08306b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49032025-03-25T01:23:10.840ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6871a0f5-717e-4585-ac1d-1ff6b2c6b546 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49042025-03-25T01:23:10.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6871a0f5-717e-4585-ac1d-1ff6b2c6b546 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49052025-03-25T01:23:10.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1815 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6871a0f5-717e-4585-ac1d-1ff6b2c6b546 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49062025-03-25T01:23:11.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
49072025-03-25T01:23:11.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49082025-03-25T01:23:11.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49092025-03-25T01:23:11.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
49102025-03-25T01:23:11.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49112025-03-25T01:23:11.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49122025-03-25T01:23:11.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49132025-03-25T01:23:11.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49142025-03-25T01:23:11.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49152025-03-25T01:23:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49162025-03-25T01:23:11.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49172025-03-25T01:23:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49182025-03-25T01:23:11.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49192025-03-25T01:23:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
49202025-03-25T01:23:11.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49212025-03-25T01:23:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49222025-03-25T01:23:11.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
49232025-03-25T01:23:11.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.642224ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
49242025-03-25T01:23:11.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49252025-03-25T01:23:11.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49262025-03-25T01:23:11.771ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.643321ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49272025-03-25T01:23:11.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05c6d10b-2a3d-4fe5-961c-8df7b0a76472 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49282025-03-25T01:23:11.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05c6d10b-2a3d-4fe5-961c-8df7b0a76472 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49292025-03-25T01:23:11.862ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1712 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05c6d10b-2a3d-4fe5-961c-8df7b0a76472 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49302025-03-25T01:23:12.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4f2ebcb8-952e-4be5-b007-df0895ece01b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49312025-03-25T01:23:12.882ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4f2ebcb8-952e-4be5-b007-df0895ece01b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49322025-03-25T01:23:12.884ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1962 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4f2ebcb8-952e-4be5-b007-df0895ece01b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49332025-03-25T01:23:13.902ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e1b75bd8-d95e-4660-b472-7bbaa7b781b9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49342025-03-25T01:23:13.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e1b75bd8-d95e-4660-b472-7bbaa7b781b9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49352025-03-25T01:23:13.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2196 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e1b75bd8-d95e-4660-b472-7bbaa7b781b9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49362025-03-25T01:23:14.923ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18ce5e90-7344-4efd-a496-4460265e25a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49372025-03-25T01:23:14.923ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18ce5e90-7344-4efd-a496-4460265e25a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49382025-03-25T01:23:14.924ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2034 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18ce5e90-7344-4efd-a496-4460265e25a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49392025-03-25T01:23:15.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 463 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 50e86162-3378-4b75-99eb-50e4b5db987c response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
49402025-03-25T01:23:15.943ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0708e9a1-93e4-4fc9-af28-4e7a3ee24d35 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49412025-03-25T01:23:15.944ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0708e9a1-93e4-4fc9-af28-4e7a3ee24d35 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49422025-03-25T01:23:15.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2092 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0708e9a1-93e4-4fc9-af28-4e7a3ee24d35 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49432025-03-25T01:23:16.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3c5c93e8-714a-43e8-844a-bb50c4188352 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49442025-03-25T01:23:16.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3c5c93e8-714a-43e8-844a-bb50c4188352 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49452025-03-25T01:23:16.970ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2456 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3c5c93e8-714a-43e8-844a-bb50c4188352 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49462025-03-25T01:23:17.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f61f662-b480-47c5-aaa2-5e61559d7da2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49472025-03-25T01:23:17.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f61f662-b480-47c5-aaa2-5e61559d7da2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49482025-03-25T01:23:17.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0f61f662-b480-47c5-aaa2-5e61559d7da2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49492025-03-25T01:23:19.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d966498-564f-4e86-9575-ac97b0f13d64 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49502025-03-25T01:23:19.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d966498-564f-4e86-9575-ac97b0f13d64 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49512025-03-25T01:23:19.011ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d966498-564f-4e86-9575-ac97b0f13d64 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49522025-03-25T01:23:20.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf303fa6-4ec0-418a-9f8f-2820e80f42e2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49532025-03-25T01:23:20.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf303fa6-4ec0-418a-9f8f-2820e80f42e2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49542025-03-25T01:23:20.033ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2134 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bf303fa6-4ec0-418a-9f8f-2820e80f42e2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49552025-03-25T01:23:21.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d8582c-b220-4f93-acdb-5226ed575d40 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49562025-03-25T01:23:21.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d8582c-b220-4f93-acdb-5226ed575d40 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49572025-03-25T01:23:21.055ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2255 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41d8582c-b220-4f93-acdb-5226ed575d40 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49582025-03-25T01:23:21.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
49592025-03-25T01:23:21.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49602025-03-25T01:23:21.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49612025-03-25T01:23:21.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
49622025-03-25T01:23:21.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49632025-03-25T01:23:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49642025-03-25T01:23:21.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49652025-03-25T01:23:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49662025-03-25T01:23:21.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49672025-03-25T01:23:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682025-03-25T01:23:21.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49692025-03-25T01:23:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49702025-03-25T01:23:21.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49712025-03-25T01:23:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
49722025-03-25T01:23:21.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49732025-03-25T01:23:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49742025-03-25T01:23:21.753ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
49752025-03-25T01:23:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.934945ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
49762025-03-25T01:23:21.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49772025-03-25T01:23:21.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49782025-03-25T01:23:21.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 37.853521ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49792025-03-25T01:23:22.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2f558d5-4820-444d-89fe-3dce5aa50aaf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49802025-03-25T01:23:22.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2f558d5-4820-444d-89fe-3dce5aa50aaf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49812025-03-25T01:23:22.077ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2f558d5-4820-444d-89fe-3dce5aa50aaf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49822025-03-25T01:23:23.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1452ddbd-87f9-45e1-b70c-355061d1dcf9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49832025-03-25T01:23:23.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1452ddbd-87f9-45e1-b70c-355061d1dcf9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49842025-03-25T01:23:23.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1977 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1452ddbd-87f9-45e1-b70c-355061d1dcf9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49852025-03-25T01:23:24.116ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 137b41ce-d54a-4120-bab7-112efa32cf2d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49862025-03-25T01:23:24.117ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 137b41ce-d54a-4120-bab7-112efa32cf2d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49872025-03-25T01:23:24.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1887 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 137b41ce-d54a-4120-bab7-112efa32cf2d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49882025-03-25T01:23:25.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7feaa34a-cbd9-4c9c-8682-b70fb1282f2b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49892025-03-25T01:23:25.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7feaa34a-cbd9-4c9c-8682-b70fb1282f2b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49902025-03-25T01:23:25.142ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2310 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7feaa34a-cbd9-4c9c-8682-b70fb1282f2b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49912025-03-25T01:23:25.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 815 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = b454ae7f-3392-4dee-8299-0d5f57fab96b response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
49922025-03-25T01:23:26.161ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b75db01-4658-45f1-9989-a5f7f1a3d747 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49932025-03-25T01:23:26.162ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b75db01-4658-45f1-9989-a5f7f1a3d747 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49942025-03-25T01:23:26.163ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2028 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b75db01-4658-45f1-9989-a5f7f1a3d747 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49952025-03-25T01:23:27.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fd673f56-d383-492c-938d-c82ba8d28f95 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49962025-03-25T01:23:27.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fd673f56-d383-492c-938d-c82ba8d28f95 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49972025-03-25T01:23:27.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2683 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fd673f56-d383-492c-938d-c82ba8d28f95 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49982025-03-25T01:23:28.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 676bf788-27a9-47a1-ac14-1041f3242c47 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
49992025-03-25T01:23:28.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 676bf788-27a9-47a1-ac14-1041f3242c47 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50002025-03-25T01:23:28.207ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1803 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 676bf788-27a9-47a1-ac14-1041f3242c47 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50012025-03-25T01:23:29.227ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fe3edab-fb55-4897-a36d-9b2c617808d4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50022025-03-25T01:23:29.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fe3edab-fb55-4897-a36d-9b2c617808d4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50032025-03-25T01:23:29.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fe3edab-fb55-4897-a36d-9b2c617808d4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50042025-03-25T01:23:30.248ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2dd4ec38-a4bb-4cc4-9b71-d5c3691a36f7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50052025-03-25T01:23:30.248ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2dd4ec38-a4bb-4cc4-9b71-d5c3691a36f7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50062025-03-25T01:23:30.250ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2dd4ec38-a4bb-4cc4-9b71-d5c3691a36f7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50072025-03-25T01:23:30.754ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:54329
50082025-03-25T01:23:30.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 0d04d975-95b0-417d-b203-539ba345975e roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
50092025-03-25T01:23:30.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 0d04d975-95b0-417d-b203-539ba345975e resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
50102025-03-25T01:23:30.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2935 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 0d04d975-95b0-417d-b203-539ba345975e response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
50112025-03-25T01:23:30.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4b4a80c6-a2f5-46ee-af26-2ffd0ef98da4 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
50122025-03-25T01:23:30.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4b4a80c6-a2f5-46ee-af26-2ffd0ef98da4 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
50132025-03-25T01:23:30.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2284 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4b4a80c6-a2f5-46ee-af26-2ffd0ef98da4 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
50142025-03-25T01:23:31.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 989301da-e3ed-4f5a-a43d-1661f2b0362d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50152025-03-25T01:23:31.271ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 989301da-e3ed-4f5a-a43d-1661f2b0362d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50162025-03-25T01:23:31.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 989301da-e3ed-4f5a-a43d-1661f2b0362d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
50172025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
50182025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
50192025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
50202025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50212025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50222025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
50232025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50242025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
50252025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50262025-03-25T01:23:31.734ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
50272025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50282025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
50292025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
50302025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
50312025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50322025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50332025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
50342025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50352025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
50362025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 9 reason = Timeout
50372025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
50382025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
50392025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
50402025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50412025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
50422025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50432025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
50442025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50452025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
50462025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
50472025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50482025-03-25T01:23:31.734ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
50492025-03-25T01:23:31.734ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:13:31.734641572 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
50502025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
50512025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 10.79\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
50522025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
50532025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
50542025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
50552025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50562025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50572025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50582025-03-25T01:23:31.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50592025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50602025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50612025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50622025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50632025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
50642025-03-25T01:23:31.735ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 451063132 } })
50652025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
50662025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50672025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50682025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
50692025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
50702025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50712025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50722025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50732025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
50742025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
50752025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50762025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
50772025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50782025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
50792025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50802025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50812025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
50822025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50832025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50842025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
50852025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
50862025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50872025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50882025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50892025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50902025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
50912025-03-25T01:23:31.735ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
50922025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
50932025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50942025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50952025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 9 reason = Timeout
50962025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
50972025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50982025-03-25T01:23:31.735ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 451326765 } })
50992025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
51002025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
51012025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51022025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
51032025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.093245ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
51042025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51052025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51062025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
51072025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51082025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
51092025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51102025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
51112025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51122025-03-25T01:23:31.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
51132025-03-25T01:23:31.736ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
51142025-03-25T01:23:31.736ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.710264ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
51152025-03-25T01:23:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51162025-03-25T01:23:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51172025-03-25T01:23:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51182025-03-25T01:23:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51192025-03-25T01:23:31.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51202025-03-25T01:23:31.738ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.728563ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
51212025-03-25T01:23:31.738ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51222025-03-25T01:23:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
51232025-03-25T01:23:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51242025-03-25T01:23:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51252025-03-25T01:23:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
51262025-03-25T01:23:31.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
51272025-03-25T01:23:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
51282025-03-25T01:23:31.741ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51292025-03-25T01:23:31.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51302025-03-25T01:23:31.743ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
51312025-03-25T01:23:31.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 459213518 } })
51322025-03-25T01:23:31.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51332025-03-25T01:23:31.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 459360140 } })
51342025-03-25T01:23:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51352025-03-25T01:23:31.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
51362025-03-25T01:23:31.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
51372025-03-25T01:23:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
51382025-03-25T01:23:31.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
51392025-03-25T01:23:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
51402025-03-25T01:23:31.748ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51412025-03-25T01:23:31.748ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:13:31.734641572 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
51422025-03-25T01:23:31.748ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.95827ms iteration = 5 status = {"expiration":"2025-03-25T01:13:31.734641572Z","pruned":[]}
51432025-03-25T01:23:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51442025-03-25T01:23:31.749ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 14.559958ms iteration = 9 status = {"errors":[],"finish_invoked_ok":[]}
51452025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51462025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51472025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51482025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51492025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51502025-03-25T01:23:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51512025-03-25T01:23:31.755ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51522025-03-25T01:23:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51532025-03-25T01:23:31.756ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.252174ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
51542025-03-25T01:23:31.757ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51552025-03-25T01:23:31.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51562025-03-25T01:23:31.759ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51572025-03-25T01:23:31.759ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51582025-03-25T01:23:31.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51592025-03-25T01:23:31.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51602025-03-25T01:23:31.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51612025-03-25T01:23:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51622025-03-25T01:23:31.762ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51632025-03-25T01:23:31.762ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.734547ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
51642025-03-25T01:23:31.763ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51652025-03-25T01:23:31.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1115, tv_nsec: 480654395 } })
51662025-03-25T01:23:31.765ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
51672025-03-25T01:23:31.765ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51682025-03-25T01:23:31.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51692025-03-25T01:23:31.766ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51702025-03-25T01:23:31.766ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51712025-03-25T01:23:31.766ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 31.559452ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51722025-03-25T01:23:31.767ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
51732025-03-25T01:23:31.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51742025-03-25T01:23:31.775ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51752025-03-25T01:23:31.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51762025-03-25T01:23:31.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51772025-03-25T01:23:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51782025-03-25T01:23:31.795ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
51792025-03-25T01:23:31.795ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.550057ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
51802025-03-25T01:23:31.806ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51812025-03-25T01:23:31.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51822025-03-25T01:23:31.810ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51832025-03-25T01:23:31.813ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51842025-03-25T01:23:31.813ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51852025-03-25T01:23:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51862025-03-25T01:23:31.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 83.764739ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51872025-03-25T01:23:31.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51882025-03-25T01:23:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51892025-03-25T01:23:31.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51902025-03-25T01:23:31.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51912025-03-25T01:23:31.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51922025-03-25T01:23:31.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51932025-03-25T01:23:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51942025-03-25T01:23:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51952025-03-25T01:23:31.829ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51962025-03-25T01:23:31.829ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51972025-03-25T01:23:31.829ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 94.242759ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51982025-03-25T01:23:31.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51992025-03-25T01:23:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52002025-03-25T01:23:31.830ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52012025-03-25T01:23:31.830ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
52022025-03-25T01:23:31.830ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52032025-03-25T01:23:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52042025-03-25T01:23:31.833ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 97.81848ms iteration = 9 status = {"errors":[],"requests_created_ok":[]}
52052025-03-25T01:23:31.834ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52062025-03-25T01:23:31.834ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
52072025-03-25T01:23:31.834ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52082025-03-25T01:23:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52092025-03-25T01:23:31.841ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52102025-03-25T01:23:31.841ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52112025-03-25T01:23:31.841ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52122025-03-25T01:23:31.841ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52132025-03-25T01:23:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52142025-03-25T01:23:31.846ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52152025-03-25T01:23:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52162025-03-25T01:23:31.851ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52172025-03-25T01:23:31.854ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52182025-03-25T01:23:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52192025-03-25T01:23:31.855ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52202025-03-25T01:23:31.855ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52212025-03-25T01:23:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52222025-03-25T01:23:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52232025-03-25T01:23:31.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52242025-03-25T01:23:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52252025-03-25T01:23:31.856ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52262025-03-25T01:23:31.857ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
52272025-03-25T01:23:31.857ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
52282025-03-25T01:23:31.857ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
52292025-03-25T01:23:31.857ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52302025-03-25T01:23:31.858ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52312025-03-25T01:23:31.858ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322025-03-25T01:23:31.860ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52332025-03-25T01:23:31.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
52342025-03-25T01:23:31.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52352025-03-25T01:23:31.860ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
52362025-03-25T01:23:31.860ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
52372025-03-25T01:23:31.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 125.872381ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
52382025-03-25T01:23:31.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52392025-03-25T01:23:31.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
52402025-03-25T01:23:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
52412025-03-25T01:23:31.862ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52422025-03-25T01:23:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52432025-03-25T01:23:31.862ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52442025-03-25T01:23:31.863ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
52452025-03-25T01:23:31.863ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52462025-03-25T01:23:31.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52472025-03-25T01:23:31.864ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52482025-03-25T01:23:31.866ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52492025-03-25T01:23:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52502025-03-25T01:23:31.866ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
52512025-03-25T01:23:31.866ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52522025-03-25T01:23:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52532025-03-25T01:23:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52542025-03-25T01:23:31.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52552025-03-25T01:23:31.869ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52562025-03-25T01:23:31.880ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 146.198762ms iteration = 9 status = 0
52572025-03-25T01:23:31.889ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52582025-03-25T01:23:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52592025-03-25T01:23:31.891ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
52602025-03-25T01:23:31.891ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 156.356397ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
52612025-03-25T01:23:31.891ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 156.688782ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
52622025-03-25T01:23:31.904ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
52632025-03-25T01:23:31.904ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
52642025-03-25T01:23:31.904ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 169.179071ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
52652025-03-25T01:23:31.905ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
52662025-03-25T01:23:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
52672025-03-25T01:23:31.914ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52682025-03-25T01:23:31.914ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52692025-03-25T01:23:31.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52702025-03-25T01:23:31.915ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52712025-03-25T01:23:31.917ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
52722025-03-25T01:23:31.917ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52732025-03-25T01:23:31.917ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52742025-03-25T01:23:31.917ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6bbb47a3-4e08-48dc-a3b9-cda3ff845117", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:31 GMT"} })
52752025-03-25T01:23:31.917ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52762025-03-25T01:23:31.917ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
52772025-03-25T01:23:31.917ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 182.983668ms iteration = 9 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
52782025-03-25T01:23:31.920ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52792025-03-25T01:23:31.921ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52802025-03-25T01:23:31.921ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52812025-03-25T01:23:31.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52822025-03-25T01:23:31.924ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
52832025-03-25T01:23:31.924ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52842025-03-25T01:23:31.924ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
52852025-03-25T01:23:31.924ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 189.731665ms iteration = 5 status = {"generation":1}
52862025-03-25T01:23:31.924ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52872025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52882025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52892025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52902025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52912025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
52922025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52932025-03-25T01:23:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52942025-03-25T01:23:31.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52952025-03-25T01:23:31.932ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52962025-03-25T01:23:31.932ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52972025-03-25T01:23:31.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52982025-03-25T01:23:31.934ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
52992025-03-25T01:23:31.934ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
53002025-03-25T01:23:31.934ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
53012025-03-25T01:23:31.934ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 199.534255ms iteration = 5 status = {"generation":2}
53022025-03-25T01:23:31.937ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53032025-03-25T01:23:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53042025-03-25T01:23:31.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 216.144453ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
53052025-03-25T01:23:31.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
53062025-03-25T01:23:31.964ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
53072025-03-25T01:23:31.964ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53082025-03-25T01:23:31.964ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a7564b-20c1-40ca-83c6-fa6cca6ba082", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:31 GMT"} })
53092025-03-25T01:23:31.964ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53102025-03-25T01:23:31.966ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
53112025-03-25T01:23:31.971ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
53122025-03-25T01:23:31.971ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 236.539475ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
53132025-03-25T01:23:31.978ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 243.658607ms iteration = 11 status = {"physical_disks_added":0}
53142025-03-25T01:23:31.980ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
53152025-03-25T01:23:31.980ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
53162025-03-25T01:23:31.980ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8455c77b-2156-4555-ba88-d38ad7456b01", "content-length": "26", "date": "Tue, 25 Mar 2025 01:23:31 GMT"} })
53172025-03-25T01:23:31.980ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
53182025-03-25T01:23:31.982ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
53192025-03-25T01:23:31.982ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53202025-03-25T01:23:31.982ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53212025-03-25T01:23:31.984ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53222025-03-25T01:23:31.986ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53232025-03-25T01:23:31.986ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53242025-03-25T01:23:31.986ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53252025-03-25T01:23:31.987ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262025-03-25T01:23:31.990ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
53272025-03-25T01:23:31.990ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53282025-03-25T01:23:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53292025-03-25T01:23:32.006ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53302025-03-25T01:23:32.006ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 271.064239ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53312025-03-25T01:23:32.080ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53322025-03-25T01:23:32.216ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
53332025-03-25T01:23:32.216ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53342025-03-25T01:23:32.217ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d920f9d6-5807-4713-9549-d1668240ead5", "content-length": "372", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53352025-03-25T01:23:32.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53362025-03-25T01:23:32.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53372025-03-25T01:23:32.221ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
53382025-03-25T01:23:32.221ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c62ef148-f752-4eef-8e2e-39857e71cc34", "content-length": "1", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53392025-03-25T01:23:32.224ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
53402025-03-25T01:23:32.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
53412025-03-25T01:23:32.226ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 491.99164ms iteration = 9 status = null
53422025-03-25T01:23:32.268ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53432025-03-25T01:23:32.268ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
53442025-03-25T01:23:32.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
53452025-03-25T01:23:32.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0277aaf8-6fb5-4bba-8f8f-52040f754d66", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53462025-03-25T01:23:32.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53472025-03-25T01:23:32.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53482025-03-25T01:23:32.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53492025-03-25T01:23:32.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53502025-03-25T01:23:32.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53512025-03-25T01:23:32.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53522025-03-25T01:23:32.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fd0b766-00ed-42d3-9faf-c454d23a9d5b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
53532025-03-25T01:23:32.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fd0b766-00ed-42d3-9faf-c454d23a9d5b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
53542025-03-25T01:23:32.295ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 560.752703ms iteration = 9 status = {}
53552025-03-25T01:23:32.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
53562025-03-25T01:23:32.422ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "75155c10-e17c-4ce9-b505-a0b096c7e3a2", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53572025-03-25T01:23:32.422ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53582025-03-25T01:23:32.423ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3a50440a-e360-413d-b6ae-65c0796d64c4", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53592025-03-25T01:23:32.423ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53602025-03-25T01:23:32.425ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
53612025-03-25T01:23:32.425ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 691.435784ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53622025-03-25T01:23:32.434ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53632025-03-25T01:23:32.436ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 142965 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fd0b766-00ed-42d3-9faf-c454d23a9d5b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
53642025-03-25T01:23:32.438ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
53652025-03-25T01:23:32.438ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53662025-03-25T01:23:32.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53672025-03-25T01:23:32.449ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "c9e26647-00fd-47d7-a62b-fff0eae5a636", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53682025-03-25T01:23:32.449ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53692025-03-25T01:23:32.450ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b7fb02b4-354c-4ee7-8b5b-732b67bb4d08", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53702025-03-25T01:23:32.450ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53712025-03-25T01:23:32.451ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "059d4ace-9339-4937-ad8c-e607738f2a28", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53722025-03-25T01:23:32.451ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53732025-03-25T01:23:32.453ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53742025-03-25T01:23:32.453ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 718.964367ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53752025-03-25T01:23:32.490ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53762025-03-25T01:23:32.490ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53772025-03-25T01:23:32.494ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
53782025-03-25T01:23:32.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53792025-03-25T01:23:32.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53802025-03-25T01:23:32.506ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53812025-03-25T01:23:32.506ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ba253e0-8863-4d51-ae74-213f765815d1", "content-length": "134", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53822025-03-25T01:23:32.506ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53832025-03-25T01:23:32.506ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
53842025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53852025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53862025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53872025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53882025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53892025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53902025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53912025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53922025-03-25T01:23:32.507ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
53932025-03-25T01:23:32.507ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53942025-03-25T01:23:32.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53952025-03-25T01:23:32.509ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53962025-03-25T01:23:32.509ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2145ec33-811d-4da0-b681-fc0c318abbaa", "content-length": "2", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53972025-03-25T01:23:32.509ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53982025-03-25T01:23:32.509ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6ac54f2-4220-442f-a4b6-7aae969f4462", "content-length": "51", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
53992025-03-25T01:23:32.509ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
54002025-03-25T01:23:32.509ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
54012025-03-25T01:23:32.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c90512e8-d58d-4346-bbb2-52956df6429b", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
54022025-03-25T01:23:32.521ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 786.2217ms iteration = 9 status = {}
54032025-03-25T01:23:32.524ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "928ffe6a-26ed-4691-835a-4ed2183a6e4f", "content-length": "691", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
54042025-03-25T01:23:32.524ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
54052025-03-25T01:23:32.524ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
54062025-03-25T01:23:32.524ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
54072025-03-25T01:23:32.526ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 791.465765ms iteration = 9 status = {}
54082025-03-25T01:23:32.618ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "951b8981-4fa4-449e-a585-f9a3702f0d41", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
54092025-03-25T01:23:32.618ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
54102025-03-25T01:23:32.618ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
54112025-03-25T01:23:32.618ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbcac2c3-4b13-4511-890b-0b6d985531ab", "content-length": "682", "date": "Tue, 25 Mar 2025 01:23:32 GMT"} })
54122025-03-25T01:23:32.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54132025-03-25T01:23:32.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54142025-03-25T01:23:32.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54152025-03-25T01:23:32.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54162025-03-25T01:23:32.626ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54172025-03-25T01:23:32.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54182025-03-25T01:23:32.629ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54192025-03-25T01:23:32.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54202025-03-25T01:23:32.636ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 902.281831ms iteration = 9 status = {}
54212025-03-25T01:23:33.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00a84750-db81-4b34-b804-11619abf9b28 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54222025-03-25T01:23:33.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00a84750-db81-4b34-b804-11619abf9b28 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54232025-03-25T01:23:33.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1943 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00a84750-db81-4b34-b804-11619abf9b28 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54242025-03-25T01:23:34.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e0af9b3-1961-479c-8a94-0e2f28dab3dd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54252025-03-25T01:23:34.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e0af9b3-1961-479c-8a94-0e2f28dab3dd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54262025-03-25T01:23:34.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1801 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9e0af9b3-1961-479c-8a94-0e2f28dab3dd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54272025-03-25T01:23:35.582ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7996fd85-3219-4007-b6ce-70bcca8c0bf1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54282025-03-25T01:23:35.582ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7996fd85-3219-4007-b6ce-70bcca8c0bf1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54292025-03-25T01:23:35.584ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7996fd85-3219-4007-b6ce-70bcca8c0bf1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54302025-03-25T01:23:35.761ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 500 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = be120fb6-7d57-41cb-8e9a-5e681e89dba5 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
54312025-03-25T01:23:36.604ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a3d96db-9a79-4ed5-b1c6-90d0962a16dc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54322025-03-25T01:23:36.604ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a3d96db-9a79-4ed5-b1c6-90d0962a16dc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54332025-03-25T01:23:36.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2607 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a3d96db-9a79-4ed5-b1c6-90d0962a16dc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54342025-03-25T01:23:37.627ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a394e302-8a77-4633-908c-ad3254ecabc3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54352025-03-25T01:23:37.628ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a394e302-8a77-4633-908c-ad3254ecabc3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54362025-03-25T01:23:37.629ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a394e302-8a77-4633-908c-ad3254ecabc3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54372025-03-25T01:23:38.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7c500d83-5b76-4ca4-b28a-1d2e4593c47f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54382025-03-25T01:23:38.650ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7c500d83-5b76-4ca4-b28a-1d2e4593c47f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54392025-03-25T01:23:38.652ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1989 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7c500d83-5b76-4ca4-b28a-1d2e4593c47f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54402025-03-25T01:23:39.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1c61e4c-0127-4534-aed8-7c488cfaa3ae roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54412025-03-25T01:23:39.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1c61e4c-0127-4534-aed8-7c488cfaa3ae resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54422025-03-25T01:23:39.675ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2489 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1c61e4c-0127-4534-aed8-7c488cfaa3ae response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54432025-03-25T01:23:40.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a3e13b61-aa27-4220-9eed-de6e4727b613 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54442025-03-25T01:23:40.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a3e13b61-aa27-4220-9eed-de6e4727b613 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54452025-03-25T01:23:40.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a3e13b61-aa27-4220-9eed-de6e4727b613 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54462025-03-25T01:23:41.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3fa1601-ab1e-48cd-94c6-98354914a7a3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54472025-03-25T01:23:41.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3fa1601-ab1e-48cd-94c6-98354914a7a3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54482025-03-25T01:23:41.723ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3fa1601-ab1e-48cd-94c6-98354914a7a3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54492025-03-25T01:23:41.734ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
54502025-03-25T01:23:41.734ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54512025-03-25T01:23:41.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54522025-03-25T01:23:41.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
54532025-03-25T01:23:41.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54542025-03-25T01:23:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54552025-03-25T01:23:41.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54562025-03-25T01:23:41.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54572025-03-25T01:23:41.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54582025-03-25T01:23:41.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.563451ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54592025-03-25T01:23:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54602025-03-25T01:23:41.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54612025-03-25T01:23:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54622025-03-25T01:23:41.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54632025-03-25T01:23:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54642025-03-25T01:23:41.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54652025-03-25T01:23:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
54662025-03-25T01:23:41.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54672025-03-25T01:23:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54682025-03-25T01:23:41.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
54692025-03-25T01:23:41.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.110806ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
54702025-03-25T01:23:42.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = beca3842-0d0f-4acd-ad5a-f3595623cd88 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54712025-03-25T01:23:42.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = beca3842-0d0f-4acd-ad5a-f3595623cd88 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54722025-03-25T01:23:42.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = beca3842-0d0f-4acd-ad5a-f3595623cd88 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54732025-03-25T01:23:43.765ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49fc0267-a316-4aaf-9cf7-4008630e038b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54742025-03-25T01:23:43.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49fc0267-a316-4aaf-9cf7-4008630e038b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54752025-03-25T01:23:43.767ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49fc0267-a316-4aaf-9cf7-4008630e038b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54762025-03-25T01:23:44.786ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d5e11f2-e208-4400-8a29-208dc4b04ab8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54772025-03-25T01:23:44.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d5e11f2-e208-4400-8a29-208dc4b04ab8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54782025-03-25T01:23:44.789ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2587 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d5e11f2-e208-4400-8a29-208dc4b04ab8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54792025-03-25T01:23:45.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 415 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 060ef0c4-0753-422e-bded-207df4547a30 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
54802025-03-25T01:23:45.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec78e76d-71ea-4eac-844c-4341ee306ba7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54812025-03-25T01:23:45.809ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec78e76d-71ea-4eac-844c-4341ee306ba7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54822025-03-25T01:23:45.811ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2422 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec78e76d-71ea-4eac-844c-4341ee306ba7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54832025-03-25T01:23:46.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8ba517d0-c996-421c-9070-8e795b4b3820 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54842025-03-25T01:23:46.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8ba517d0-c996-421c-9070-8e795b4b3820 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54852025-03-25T01:23:46.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8ba517d0-c996-421c-9070-8e795b4b3820 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54862025-03-25T01:23:47.855ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7df275f6-e022-4f5c-a886-4db9fabfeeb0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54872025-03-25T01:23:47.856ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7df275f6-e022-4f5c-a886-4db9fabfeeb0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54882025-03-25T01:23:47.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2069 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7df275f6-e022-4f5c-a886-4db9fabfeeb0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54892025-03-25T01:23:48.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 274fff53-01ee-4e6b-aefc-f299ad2a77e5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54902025-03-25T01:23:48.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 274fff53-01ee-4e6b-aefc-f299ad2a77e5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54912025-03-25T01:23:48.880ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2277 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 274fff53-01ee-4e6b-aefc-f299ad2a77e5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54922025-03-25T01:23:49.903ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61e5e941-5985-41ab-801a-08cfcac9a2be roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54932025-03-25T01:23:49.903ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61e5e941-5985-41ab-801a-08cfcac9a2be resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54942025-03-25T01:23:49.905ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2363 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61e5e941-5985-41ab-801a-08cfcac9a2be response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54952025-03-25T01:23:50.925ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60b83619-6714-4aa2-a28e-6b4f23a4985e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54962025-03-25T01:23:50.925ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60b83619-6714-4aa2-a28e-6b4f23a4985e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54972025-03-25T01:23:50.927ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2633 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60b83619-6714-4aa2-a28e-6b4f23a4985e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
54982025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
54992025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55002025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55012025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
55022025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55032025-03-25T01:23:51.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55042025-03-25T01:23:51.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55052025-03-25T01:23:51.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55062025-03-25T01:23:51.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55072025-03-25T01:23:51.739ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.570062ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55082025-03-25T01:23:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55092025-03-25T01:23:51.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55102025-03-25T01:23:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55112025-03-25T01:23:51.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55122025-03-25T01:23:51.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55132025-03-25T01:23:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55142025-03-25T01:23:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
55152025-03-25T01:23:51.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55162025-03-25T01:23:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55172025-03-25T01:23:51.750ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
55182025-03-25T01:23:51.750ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.637154ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
55192025-03-25T01:23:51.947ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b27c5e85-9818-4e52-a433-65de958214be roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55202025-03-25T01:23:51.948ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b27c5e85-9818-4e52-a433-65de958214be resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55212025-03-25T01:23:51.950ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b27c5e85-9818-4e52-a433-65de958214be response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55222025-03-25T01:23:52.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8004d9f-386c-4ec4-944c-8ddda69ad11e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55232025-03-25T01:23:52.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8004d9f-386c-4ec4-944c-8ddda69ad11e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55242025-03-25T01:23:52.972ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c8004d9f-386c-4ec4-944c-8ddda69ad11e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55252025-03-25T01:23:53.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 99e7f8ea-1ba0-4340-9167-d22a310dfb2b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55262025-03-25T01:23:53.993ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 99e7f8ea-1ba0-4340-9167-d22a310dfb2b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55272025-03-25T01:23:53.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2674 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 99e7f8ea-1ba0-4340-9167-d22a310dfb2b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55282025-03-25T01:23:55.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f830c23e-95e6-4c02-ae34-7a59de7d27db roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55292025-03-25T01:23:55.016ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f830c23e-95e6-4c02-ae34-7a59de7d27db resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55302025-03-25T01:23:55.017ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f830c23e-95e6-4c02-ae34-7a59de7d27db response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55312025-03-25T01:23:55.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 675 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 000e9954-6f4c-47e0-8a02-f801ef57a7e0 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
55322025-03-25T01:23:56.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6529d864-f82d-4c15-9391-cbf8e47743e6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55332025-03-25T01:23:56.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6529d864-f82d-4c15-9391-cbf8e47743e6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55342025-03-25T01:23:56.039ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2074 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6529d864-f82d-4c15-9391-cbf8e47743e6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55352025-03-25T01:23:57.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe5495a-4c28-4730-8f9b-8da5f5c1b2fc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55362025-03-25T01:23:57.059ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe5495a-4c28-4730-8f9b-8da5f5c1b2fc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55372025-03-25T01:23:57.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe5495a-4c28-4730-8f9b-8da5f5c1b2fc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55382025-03-25T01:23:58.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 960fb62f-eea9-4ba5-b250-37ebeadf6c7b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55392025-03-25T01:23:58.083ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 960fb62f-eea9-4ba5-b250-37ebeadf6c7b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55402025-03-25T01:23:58.085ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2222 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 960fb62f-eea9-4ba5-b250-37ebeadf6c7b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55412025-03-25T01:23:59.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e0ccea14-87cd-498b-aa8d-bf7a39893f6c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55422025-03-25T01:23:59.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e0ccea14-87cd-498b-aa8d-bf7a39893f6c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55432025-03-25T01:23:59.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2055 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e0ccea14-87cd-498b-aa8d-bf7a39893f6c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55442025-03-25T01:24:00.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ef79b48b-01df-4f61-9f89-cf099a7be793 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55452025-03-25T01:24:00.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ef79b48b-01df-4f61-9f89-cf099a7be793 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55462025-03-25T01:24:00.131ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2569 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ef79b48b-01df-4f61-9f89-cf099a7be793 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55472025-03-25T01:24:00.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 3f8bc3b2-9be4-4aca-9389-7d262a21d85a roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
55482025-03-25T01:24:00.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 3f8bc3b2-9be4-4aca-9389-7d262a21d85a resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
55492025-03-25T01:24:00.757ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2885 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 3f8bc3b2-9be4-4aca-9389-7d262a21d85a response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
55502025-03-25T01:24:00.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 597a0b89-c7b6-4c93-8468-957b8efb4ca6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
55512025-03-25T01:24:00.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 597a0b89-c7b6-4c93-8468-957b8efb4ca6 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
55522025-03-25T01:24:00.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 597a0b89-c7b6-4c93-8468-957b8efb4ca6 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
55532025-03-25T01:24:01.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5c90bd6-bfb7-4ca5-93aa-ff30eeba347e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55542025-03-25T01:24:01.153ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5c90bd6-bfb7-4ca5-93aa-ff30eeba347e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55552025-03-25T01:24:01.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c5c90bd6-bfb7-4ca5-93aa-ff30eeba347e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
55562025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
55572025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
55582025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55592025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55602025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
55612025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
55622025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55632025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
55642025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55652025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55662025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
55672025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55682025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
55692025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55702025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
55712025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
55722025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 10 reason = Timeout
55732025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
55742025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
55752025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55762025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55772025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55782025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55792025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55802025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55812025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55822025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
55832025-03-25T01:24:01.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
55842025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
55852025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
55862025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
55872025-03-25T01:24:01.736ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
55882025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
55892025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
55902025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55912025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55922025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
55932025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
55942025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
55952025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
55962025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
55972025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55982025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 10 reason = Timeout
55992025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
56002025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
56012025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56022025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
56032025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56042025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
56052025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56062025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
56072025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56082025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56092025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
56102025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56112025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56122025-03-25T01:24:01.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56132025-03-25T01:24:01.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56142025-03-25T01:24:01.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56152025-03-25T01:24:01.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56162025-03-25T01:24:01.739ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.846375ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56172025-03-25T01:24:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56182025-03-25T01:24:01.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56192025-03-25T01:24:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
56202025-03-25T01:24:01.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56212025-03-25T01:24:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56222025-03-25T01:24:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56232025-03-25T01:24:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56242025-03-25T01:24:01.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56252025-03-25T01:24:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56262025-03-25T01:24:01.743ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56272025-03-25T01:24:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56282025-03-25T01:24:01.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56292025-03-25T01:24:01.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56302025-03-25T01:24:01.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 460296784 } })
56312025-03-25T01:24:01.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
56322025-03-25T01:24:01.745ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.233382ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
56332025-03-25T01:24:01.746ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 461652183 } })
56342025-03-25T01:24:01.746ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
56352025-03-25T01:24:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56362025-03-25T01:24:01.747ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56372025-03-25T01:24:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56382025-03-25T01:24:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
56392025-03-25T01:24:01.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56402025-03-25T01:24:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56412025-03-25T01:24:01.748ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56422025-03-25T01:24:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56432025-03-25T01:24:01.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56442025-03-25T01:24:01.750ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56452025-03-25T01:24:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56462025-03-25T01:24:01.752ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56472025-03-25T01:24:01.752ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56482025-03-25T01:24:01.752ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56492025-03-25T01:24:01.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56502025-03-25T01:24:01.752ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56512025-03-25T01:24:01.752ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56522025-03-25T01:24:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56532025-03-25T01:24:01.755ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56542025-03-25T01:24:01.757ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.520434ms iteration = 10 status = {"errors":[],"finish_invoked_ok":[]}
56552025-03-25T01:24:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
56562025-03-25T01:24:01.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56572025-03-25T01:24:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56582025-03-25T01:24:01.762ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56592025-03-25T01:24:01.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56602025-03-25T01:24:01.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1145, tv_nsec: 480062877 } })
56612025-03-25T01:24:01.764ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
56622025-03-25T01:24:01.765ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56632025-03-25T01:24:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56642025-03-25T01:24:01.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56652025-03-25T01:24:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56662025-03-25T01:24:01.766ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
56672025-03-25T01:24:01.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
56682025-03-25T01:24:01.767ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 32.088689ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56692025-03-25T01:24:01.771ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
56702025-03-25T01:24:01.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
56712025-03-25T01:24:01.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56722025-03-25T01:24:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
56732025-03-25T01:24:01.774ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56742025-03-25T01:24:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56752025-03-25T01:24:01.776ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 39.927601ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
56762025-03-25T01:24:01.777ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 40.584011ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
56772025-03-25T01:24:01.782ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
56782025-03-25T01:24:01.782ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 46.12928ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
56792025-03-25T01:24:01.814ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56802025-03-25T01:24:01.814ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
56812025-03-25T01:24:01.814ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56822025-03-25T01:24:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56832025-03-25T01:24:01.820ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 83.86661ms iteration = 10 status = {"errors":[],"requests_created_ok":[]}
56842025-03-25T01:24:01.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56852025-03-25T01:24:01.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56862025-03-25T01:24:01.823ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56872025-03-25T01:24:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56882025-03-25T01:24:01.824ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56892025-03-25T01:24:01.826ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56902025-03-25T01:24:01.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56912025-03-25T01:24:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56922025-03-25T01:24:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56932025-03-25T01:24:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
56942025-03-25T01:24:01.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
56952025-03-25T01:24:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
56962025-03-25T01:24:01.829ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 93.034011ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56972025-03-25T01:24:01.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56982025-03-25T01:24:01.831ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56992025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57002025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57012025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
57022025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57032025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57042025-03-25T01:24:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57052025-03-25T01:24:01.835ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.62983ms iteration = 10 status = 0
57062025-03-25T01:24:01.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57072025-03-25T01:24:01.836ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57082025-03-25T01:24:01.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57092025-03-25T01:24:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
57102025-03-25T01:24:01.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57112025-03-25T01:24:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57122025-03-25T01:24:01.850ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
57132025-03-25T01:24:01.850ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 114.806902ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
57142025-03-25T01:24:01.859ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
57152025-03-25T01:24:01.859ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57162025-03-25T01:24:01.860ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8cb7e7c-1508-45c8-8e86-1210d417dbeb", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57172025-03-25T01:24:01.860ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57182025-03-25T01:24:01.861ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
57192025-03-25T01:24:01.866ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
57202025-03-25T01:24:01.866ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 130.981024ms iteration = 10 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
57212025-03-25T01:24:01.867ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57222025-03-25T01:24:01.867ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57232025-03-25T01:24:01.867ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.70849ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57242025-03-25T01:24:01.869ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
57252025-03-25T01:24:01.869ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57262025-03-25T01:24:01.870ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e43c05f-507b-412f-84c3-6db3b833be1f", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57272025-03-25T01:24:01.870ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57282025-03-25T01:24:01.871ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
57292025-03-25T01:24:01.872ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57302025-03-25T01:24:01.872ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2c4ce58-dffd-4fc1-9f06-70822131eeb4", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57312025-03-25T01:24:01.872ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57322025-03-25T01:24:01.872ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57332025-03-25T01:24:01.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57342025-03-25T01:24:01.882ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57352025-03-25T01:24:01.885ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57362025-03-25T01:24:01.885ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57372025-03-25T01:24:01.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57382025-03-25T01:24:01.903ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.766951ms iteration = 12 status = {"physical_disks_added":0}
57392025-03-25T01:24:01.946ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57402025-03-25T01:24:01.946ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57412025-03-25T01:24:01.946ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "f3402a05-b8a4-4ef0-8373-d451dd018d93", "content-length": "372", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57422025-03-25T01:24:01.946ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57432025-03-25T01:24:01.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57442025-03-25T01:24:01.947ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57452025-03-25T01:24:01.949ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57462025-03-25T01:24:01.949ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57472025-03-25T01:24:01.949ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57482025-03-25T01:24:01.962ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57492025-03-25T01:24:01.962ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57502025-03-25T01:24:01.962ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "796433a9-0a68-40ad-a78b-6dc75a73e3a7", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57512025-03-25T01:24:01.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57522025-03-25T01:24:01.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57532025-03-25T01:24:01.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57542025-03-25T01:24:01.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57552025-03-25T01:24:01.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57562025-03-25T01:24:01.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57572025-03-25T01:24:01.970ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
57582025-03-25T01:24:01.970ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57592025-03-25T01:24:01.971ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "93b6071e-934c-41d2-916b-57ab54f41dd7", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57602025-03-25T01:24:01.972ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 236.349252ms iteration = 10 status = {}
57612025-03-25T01:24:01.983ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57622025-03-25T01:24:01.983ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb293488-c53d-477f-af7c-39862892dc9e", "content-length": "1", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57632025-03-25T01:24:01.985ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57642025-03-25T01:24:01.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57652025-03-25T01:24:02.008ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 272.59804ms iteration = 10 status = {}
57662025-03-25T01:24:02.072ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
57672025-03-25T01:24:02.072ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e06b80da-66f3-47c1-8dfb-d085372e259f", "content-length": "691", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57682025-03-25T01:24:02.072ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
57692025-03-25T01:24:02.073ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
57702025-03-25T01:24:02.073ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
57712025-03-25T01:24:02.074ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 339.350096ms iteration = 10 status = {}
57722025-03-25T01:24:02.074ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 339.459588ms iteration = 10 status = null
57732025-03-25T01:24:02.092ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57742025-03-25T01:24:02.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57752025-03-25T01:24:02.094ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
57762025-03-25T01:24:02.094ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57772025-03-25T01:24:02.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57782025-03-25T01:24:02.111ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
57792025-03-25T01:24:02.112ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "513182f7-1702-488c-93bf-8c206d1b04b9", "content-length": "134", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57802025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
57812025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
57822025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
57832025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
57842025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57852025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57862025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57872025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57882025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
57892025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
57902025-03-25T01:24:02.112ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
57912025-03-25T01:24:02.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57922025-03-25T01:24:02.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57932025-03-25T01:24:02.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
57942025-03-25T01:24:02.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b0b93e1f-24c0-4c1a-983d-c6e76d39c963", "content-length": "2", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57952025-03-25T01:24:02.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
57962025-03-25T01:24:02.115ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e6c509bf-40e5-4fc6-a527-b9ebb239ded8", "content-length": "51", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
57972025-03-25T01:24:02.115ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
57982025-03-25T01:24:02.115ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
57992025-03-25T01:24:02.215ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4fd8b28f-3a65-4b1d-a737-9a6353c7e651", "date": "Tue, 25 Mar 2025 01:24:01 GMT"} })
58002025-03-25T01:24:02.215ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
58012025-03-25T01:24:02.215ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58022025-03-25T01:24:02.215ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d2ef262-83a4-4aba-bff2-da0cdfef41c6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58032025-03-25T01:24:02.216ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d2ef262-83a4-4aba-bff2-da0cdfef41c6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58042025-03-25T01:24:02.216ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f753ffec-af2b-4c35-a0a6-a7cba39256a7", "content-length": "682", "date": "Tue, 25 Mar 2025 01:24:02 GMT"} })
58052025-03-25T01:24:02.216ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58062025-03-25T01:24:02.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58072025-03-25T01:24:02.218ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2481 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d2ef262-83a4-4aba-bff2-da0cdfef41c6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58082025-03-25T01:24:02.220ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58092025-03-25T01:24:02.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58102025-03-25T01:24:02.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58112025-03-25T01:24:02.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58122025-03-25T01:24:02.225ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58132025-03-25T01:24:02.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58142025-03-25T01:24:02.233ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 498.124388ms iteration = 10 status = {}
58152025-03-25T01:24:03.237ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f88c1c19-309e-4c12-bac2-286f54a7f29d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58162025-03-25T01:24:03.238ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f88c1c19-309e-4c12-bac2-286f54a7f29d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58172025-03-25T01:24:03.239ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f88c1c19-309e-4c12-bac2-286f54a7f29d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58182025-03-25T01:24:04.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cae82964-923b-4acb-8ca8-eec780d616d3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58192025-03-25T01:24:04.260ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cae82964-923b-4acb-8ca8-eec780d616d3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58202025-03-25T01:24:04.262ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2465 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cae82964-923b-4acb-8ca8-eec780d616d3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58212025-03-25T01:24:05.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb2f4b86-ff10-48aa-b2bf-71a18875f7a2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58222025-03-25T01:24:05.283ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb2f4b86-ff10-48aa-b2bf-71a18875f7a2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58232025-03-25T01:24:05.285ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2389 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cb2f4b86-ff10-48aa-b2bf-71a18875f7a2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58242025-03-25T01:24:05.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 777 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = e16241e2-3bac-4811-af98-668394d34b26 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
58252025-03-25T01:24:06.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 797aa070-dc5f-4a37-87f5-91883fea97dd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58262025-03-25T01:24:06.305ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 797aa070-dc5f-4a37-87f5-91883fea97dd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58272025-03-25T01:24:06.307ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2276 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 797aa070-dc5f-4a37-87f5-91883fea97dd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58282025-03-25T01:24:07.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea6027ef-a65b-492a-9f7e-dcc31b2ab4d2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58292025-03-25T01:24:07.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea6027ef-a65b-492a-9f7e-dcc31b2ab4d2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58302025-03-25T01:24:07.332ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2798 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea6027ef-a65b-492a-9f7e-dcc31b2ab4d2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58312025-03-25T01:24:08.353ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61d1bedd-82ca-4ca8-b3d9-2d51e7e6beb5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58322025-03-25T01:24:08.353ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61d1bedd-82ca-4ca8-b3d9-2d51e7e6beb5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58332025-03-25T01:24:08.355ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 61d1bedd-82ca-4ca8-b3d9-2d51e7e6beb5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58342025-03-25T01:24:09.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 98c8ffdb-eda9-4154-bb7f-74b1ccfe237c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58352025-03-25T01:24:09.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 98c8ffdb-eda9-4154-bb7f-74b1ccfe237c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58362025-03-25T01:24:09.378ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 98c8ffdb-eda9-4154-bb7f-74b1ccfe237c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58372025-03-25T01:24:10.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd370d6-7c46-49bc-9c73-6a1ce0f887f3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58382025-03-25T01:24:10.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd370d6-7c46-49bc-9c73-6a1ce0f887f3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58392025-03-25T01:24:10.401ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2116 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd370d6-7c46-49bc-9c73-6a1ce0f887f3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58402025-03-25T01:24:11.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b663387a-2f07-46bd-9cfa-c3c0ee1c7729 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58412025-03-25T01:24:11.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b663387a-2f07-46bd-9cfa-c3c0ee1c7729 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58422025-03-25T01:24:11.424ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b663387a-2f07-46bd-9cfa-c3c0ee1c7729 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58432025-03-25T01:24:11.735ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
58442025-03-25T01:24:11.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58452025-03-25T01:24:11.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58462025-03-25T01:24:11.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
58472025-03-25T01:24:11.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58482025-03-25T01:24:11.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58492025-03-25T01:24:11.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58502025-03-25T01:24:11.767ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58512025-03-25T01:24:11.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58522025-03-25T01:24:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58532025-03-25T01:24:11.770ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58542025-03-25T01:24:11.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58552025-03-25T01:24:11.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58562025-03-25T01:24:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58572025-03-25T01:24:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58582025-03-25T01:24:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
58592025-03-25T01:24:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58602025-03-25T01:24:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58612025-03-25T01:24:11.787ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
58622025-03-25T01:24:11.787ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.820231ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
58632025-03-25T01:24:11.800ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.242419ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58642025-03-25T01:24:12.445ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6ea413eb-0015-42ea-8eaf-28db19277ccb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58652025-03-25T01:24:12.445ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6ea413eb-0015-42ea-8eaf-28db19277ccb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58662025-03-25T01:24:12.447ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2018 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6ea413eb-0015-42ea-8eaf-28db19277ccb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58672025-03-25T01:24:13.467ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8dbddad-b486-41a1-a16e-6cc90474a834 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58682025-03-25T01:24:13.467ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8dbddad-b486-41a1-a16e-6cc90474a834 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58692025-03-25T01:24:13.469ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8dbddad-b486-41a1-a16e-6cc90474a834 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58702025-03-25T01:24:14.489ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5aac2800-d891-444a-8ec6-69d36e54acfa roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58712025-03-25T01:24:14.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5aac2800-d891-444a-8ec6-69d36e54acfa resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58722025-03-25T01:24:14.491ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5aac2800-d891-444a-8ec6-69d36e54acfa response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58732025-03-25T01:24:15.512ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 345d70e3-a8da-44b4-a7a4-365744480571 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58742025-03-25T01:24:15.512ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 345d70e3-a8da-44b4-a7a4-365744480571 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58752025-03-25T01:24:15.513ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1343 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 345d70e3-a8da-44b4-a7a4-365744480571 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58762025-03-25T01:24:15.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 452 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = c78c6dad-b307-4252-b9b9-84294f27cbc8 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
58772025-03-25T01:24:16.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8fafb61-f9ff-4197-8d01-52d3a61ed15c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58782025-03-25T01:24:16.533ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8fafb61-f9ff-4197-8d01-52d3a61ed15c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58792025-03-25T01:24:16.535ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2241 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a8fafb61-f9ff-4197-8d01-52d3a61ed15c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58802025-03-25T01:24:17.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d55c27b-10ac-47dc-b8fe-52c1d0ae3a12 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58812025-03-25T01:24:17.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d55c27b-10ac-47dc-b8fe-52c1d0ae3a12 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58822025-03-25T01:24:17.557ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3d55c27b-10ac-47dc-b8fe-52c1d0ae3a12 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58832025-03-25T01:24:18.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f7cb336-f891-4a77-a792-a77120901ce4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58842025-03-25T01:24:18.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f7cb336-f891-4a77-a792-a77120901ce4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58852025-03-25T01:24:18.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2632 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f7cb336-f891-4a77-a792-a77120901ce4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58862025-03-25T01:24:19.601ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52ec72dd-086d-47dd-9c30-e73b9e5fff3e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58872025-03-25T01:24:19.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52ec72dd-086d-47dd-9c30-e73b9e5fff3e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58882025-03-25T01:24:19.603ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 52ec72dd-086d-47dd-9c30-e73b9e5fff3e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58892025-03-25T01:24:20.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00048b74-d808-4e5e-8eb6-20566bf2b3ab roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58902025-03-25T01:24:20.625ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00048b74-d808-4e5e-8eb6-20566bf2b3ab resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58912025-03-25T01:24:20.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1776 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 00048b74-d808-4e5e-8eb6-20566bf2b3ab response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58922025-03-25T01:24:21.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e9908b69-4650-4b4f-b47b-94e35dfc18cf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58932025-03-25T01:24:21.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e9908b69-4650-4b4f-b47b-94e35dfc18cf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58942025-03-25T01:24:21.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e9908b69-4650-4b4f-b47b-94e35dfc18cf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
58952025-03-25T01:24:21.735ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
58962025-03-25T01:24:21.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58972025-03-25T01:24:21.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58982025-03-25T01:24:21.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
58992025-03-25T01:24:21.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59002025-03-25T01:24:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59012025-03-25T01:24:21.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022025-03-25T01:24:21.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59032025-03-25T01:24:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59042025-03-25T01:24:21.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.694592ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59052025-03-25T01:24:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59062025-03-25T01:24:21.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59072025-03-25T01:24:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59082025-03-25T01:24:21.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59092025-03-25T01:24:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59102025-03-25T01:24:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59112025-03-25T01:24:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
59122025-03-25T01:24:21.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59132025-03-25T01:24:21.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59142025-03-25T01:24:21.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
59152025-03-25T01:24:21.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.891629ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
59162025-03-25T01:24:22.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af1a83f5-7f6d-41ba-b9ca-bef70ba469d2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59172025-03-25T01:24:22.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af1a83f5-7f6d-41ba-b9ca-bef70ba469d2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59182025-03-25T01:24:22.671ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2165 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af1a83f5-7f6d-41ba-b9ca-bef70ba469d2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59192025-03-25T01:24:23.693ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3bfa2f5e-7e9d-46d8-8a12-dac98c4a25af roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59202025-03-25T01:24:23.693ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3bfa2f5e-7e9d-46d8-8a12-dac98c4a25af resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59212025-03-25T01:24:23.695ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2173 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3bfa2f5e-7e9d-46d8-8a12-dac98c4a25af response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59222025-03-25T01:24:24.717ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bb8a3170-a448-4a28-a5cb-a09fb712d47b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59232025-03-25T01:24:24.717ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bb8a3170-a448-4a28-a5cb-a09fb712d47b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59242025-03-25T01:24:24.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1886 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bb8a3170-a448-4a28-a5cb-a09fb712d47b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59252025-03-25T01:24:25.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bc8feb9-64ec-40aa-b677-56e8fdbe18d3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59262025-03-25T01:24:25.739ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bc8feb9-64ec-40aa-b677-56e8fdbe18d3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59272025-03-25T01:24:25.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1852 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bc8feb9-64ec-40aa-b677-56e8fdbe18d3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59282025-03-25T01:24:25.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 503 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = c505fee3-e64a-43ff-949b-498f05d7a241 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
59292025-03-25T01:24:26.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be729ae0-37bc-4d96-851d-77b8ee90d199 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59302025-03-25T01:24:26.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be729ae0-37bc-4d96-851d-77b8ee90d199 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59312025-03-25T01:24:26.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be729ae0-37bc-4d96-851d-77b8ee90d199 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59322025-03-25T01:24:27.782ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b3091421-0811-46e4-a0b8-0011d2320f47 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59332025-03-25T01:24:27.782ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b3091421-0811-46e4-a0b8-0011d2320f47 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59342025-03-25T01:24:27.784ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2235 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b3091421-0811-46e4-a0b8-0011d2320f47 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59352025-03-25T01:24:28.804ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a2d59f52-16e2-4fe4-b0d9-6cd69181d148 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59362025-03-25T01:24:28.804ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a2d59f52-16e2-4fe4-b0d9-6cd69181d148 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59372025-03-25T01:24:28.806ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2548 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a2d59f52-16e2-4fe4-b0d9-6cd69181d148 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59382025-03-25T01:24:29.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce5874e-6034-4f2e-bbb5-0d46e36844b2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59392025-03-25T01:24:29.826ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce5874e-6034-4f2e-bbb5-0d46e36844b2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59402025-03-25T01:24:29.827ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1700 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9ce5874e-6034-4f2e-bbb5-0d46e36844b2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59412025-03-25T01:24:30.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 101fc259-9ed3-4b7c-bfc5-6aac689a8a42 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
59422025-03-25T01:24:30.755ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 101fc259-9ed3-4b7c-bfc5-6aac689a8a42 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
59432025-03-25T01:24:30.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5836 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 101fc259-9ed3-4b7c-bfc5-6aac689a8a42 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
59442025-03-25T01:24:30.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = fee41a39-3078-4228-b551-8d496e0e272b roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
59452025-03-25T01:24:30.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = fee41a39-3078-4228-b551-8d496e0e272b resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
59462025-03-25T01:24:30.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2441 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = fee41a39-3078-4228-b551-8d496e0e272b response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
59472025-03-25T01:24:30.849ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8387c7d-a0c1-4331-9f34-3cd2e2df1089 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59482025-03-25T01:24:30.850ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8387c7d-a0c1-4331-9f34-3cd2e2df1089 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59492025-03-25T01:24:30.851ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2155 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f8387c7d-a0c1-4331-9f34-3cd2e2df1089 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
59502025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
59512025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
59522025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59532025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
59542025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59552025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59562025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
59572025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59582025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
59592025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59602025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 11 reason = Timeout
59612025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
59622025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59632025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
59642025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
59652025-03-25T01:24:31.735ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
59662025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59672025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
59682025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59692025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
59702025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59712025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59722025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
59732025-03-25T01:24:31.736ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
59742025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
59752025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
59762025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.98\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
59772025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
59782025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
59792025-03-25T01:24:31.736ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59802025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59812025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59822025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
59832025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59842025-03-25T01:24:31.736ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:14:31.736075791 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59852025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59862025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
59872025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59882025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
59892025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59902025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 4 reason = Timeout
59912025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
59922025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
59932025-03-25T01:24:31.736ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59942025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59952025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
59962025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
59972025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
59982025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
59992025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60002025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
60012025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
60022025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
60032025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
60042025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
60052025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
60062025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
60072025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 11 reason = Timeout
60082025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
60092025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60102025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
60112025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60122025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
60132025-03-25T01:24:31.736ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
60142025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60152025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60162025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
60172025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
60182025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
60192025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
60202025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60212025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
60222025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 2 reason = Timeout
60232025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
60242025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
60252025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
60262025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
60272025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
60282025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60292025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
60302025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60312025-03-25T01:24:31.736ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 451811273 } })
60322025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60332025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60342025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60352025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60362025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60372025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
60382025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
60392025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60402025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60412025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
60422025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60432025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
60442025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60452025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
60462025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
60472025-03-25T01:24:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
60482025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
60492025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
60502025-03-25T01:24:31.737ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 452096737 } })
60512025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
60522025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60532025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
60542025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
60552025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.514832ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
60562025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
60572025-03-25T01:24:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.566383ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
60582025-03-25T01:24:31.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60592025-03-25T01:24:31.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60602025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60612025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60622025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60632025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60642025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60652025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60662025-03-25T01:24:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.293651ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60672025-03-25T01:24:31.741ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 456172245 } })
60682025-03-25T01:24:31.741ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
60692025-03-25T01:24:31.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60702025-03-25T01:24:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60712025-03-25T01:24:31.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 458041292 } })
60722025-03-25T01:24:31.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
60732025-03-25T01:24:31.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60742025-03-25T01:24:31.744ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:14:31.736075791 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60752025-03-25T01:24:31.744ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.285619ms iteration = 6 status = {"expiration":"2025-03-25T01:14:31.736075791Z","pruned":[]}
60762025-03-25T01:24:31.744ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60772025-03-25T01:24:31.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60782025-03-25T01:24:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60792025-03-25T01:24:31.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60802025-03-25T01:24:31.747ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60812025-03-25T01:24:31.747ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60822025-03-25T01:24:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60832025-03-25T01:24:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60842025-03-25T01:24:31.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60852025-03-25T01:24:31.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60862025-03-25T01:24:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60872025-03-25T01:24:31.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60882025-03-25T01:24:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60892025-03-25T01:24:31.752ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60902025-03-25T01:24:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60912025-03-25T01:24:31.752ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60922025-03-25T01:24:31.752ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.72161ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
60932025-03-25T01:24:31.754ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
60942025-03-25T01:24:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
60952025-03-25T01:24:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
60962025-03-25T01:24:31.755ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
60972025-03-25T01:24:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
60982025-03-25T01:24:31.757ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60992025-03-25T01:24:31.758ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61002025-03-25T01:24:31.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61012025-03-25T01:24:31.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61022025-03-25T01:24:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61032025-03-25T01:24:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61042025-03-25T01:24:31.761ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61052025-03-25T01:24:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61062025-03-25T01:24:31.765ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61072025-03-25T01:24:31.768ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
61082025-03-25T01:24:31.768ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61092025-03-25T01:24:31.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61102025-03-25T01:24:31.776ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61112025-03-25T01:24:31.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122025-03-25T01:24:31.777ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61132025-03-25T01:24:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61142025-03-25T01:24:31.778ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61152025-03-25T01:24:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61162025-03-25T01:24:31.780ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1175, tv_nsec: 495144263 } })
61172025-03-25T01:24:31.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
61182025-03-25T01:24:31.781ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61192025-03-25T01:24:31.783ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61202025-03-25T01:24:31.787ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61212025-03-25T01:24:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61222025-03-25T01:24:31.790ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61232025-03-25T01:24:31.790ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61242025-03-25T01:24:31.791ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61252025-03-25T01:24:31.792ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61262025-03-25T01:24:31.792ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61272025-03-25T01:24:31.792ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61282025-03-25T01:24:31.792ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61292025-03-25T01:24:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61302025-03-25T01:24:31.793ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
61312025-03-25T01:24:31.793ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61322025-03-25T01:24:31.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
61332025-03-25T01:24:31.794ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61342025-03-25T01:24:31.795ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61352025-03-25T01:24:31.795ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61362025-03-25T01:24:31.796ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61372025-03-25T01:24:31.798ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61382025-03-25T01:24:31.799ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61392025-03-25T01:24:31.799ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61402025-03-25T01:24:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61412025-03-25T01:24:31.802ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
61422025-03-25T01:24:31.802ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
61432025-03-25T01:24:31.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
61442025-03-25T01:24:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
61452025-03-25T01:24:31.803ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61462025-03-25T01:24:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61472025-03-25T01:24:31.811ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 75.290317ms iteration = 11 status = {"errors":[],"finish_invoked_ok":[]}
61482025-03-25T01:24:31.815ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61492025-03-25T01:24:31.815ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61502025-03-25T01:24:31.816ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61512025-03-25T01:24:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61522025-03-25T01:24:31.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61532025-03-25T01:24:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61542025-03-25T01:24:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61552025-03-25T01:24:31.819ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61562025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61572025-03-25T01:24:31.820ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61582025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61592025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61602025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
61612025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61622025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61642025-03-25T01:24:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61652025-03-25T01:24:31.822ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61662025-03-25T01:24:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61672025-03-25T01:24:31.823ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
61682025-03-25T01:24:31.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
61692025-03-25T01:24:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
61702025-03-25T01:24:31.825ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61712025-03-25T01:24:31.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
61722025-03-25T01:24:31.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
61732025-03-25T01:24:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61742025-03-25T01:24:31.836ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61752025-03-25T01:24:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61762025-03-25T01:24:31.839ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 103.586432ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
61772025-03-25T01:24:31.841ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
61782025-03-25T01:24:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
61792025-03-25T01:24:31.844ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 108.509252ms iteration = 11 status = {"errors":[],"requests_created_ok":[]}
61802025-03-25T01:24:31.847ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
61812025-03-25T01:24:31.847ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
61822025-03-25T01:24:31.847ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 111.06053ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
61832025-03-25T01:24:31.847ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61842025-03-25T01:24:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61852025-03-25T01:24:31.850ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
61862025-03-25T01:24:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
61872025-03-25T01:24:31.852ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61882025-03-25T01:24:31.852ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61892025-03-25T01:24:31.852ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61902025-03-25T01:24:31.852ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61912025-03-25T01:24:31.852ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61922025-03-25T01:24:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61932025-03-25T01:24:31.855ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61942025-03-25T01:24:31.855ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61952025-03-25T01:24:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61962025-03-25T01:24:31.859ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61972025-03-25T01:24:31.860ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
61982025-03-25T01:24:31.860ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61992025-03-25T01:24:31.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62002025-03-25T01:24:31.862ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62012025-03-25T01:24:31.863ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
62022025-03-25T01:24:31.863ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
62032025-03-25T01:24:31.863ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 127.342652ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
62042025-03-25T01:24:31.864ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
62052025-03-25T01:24:31.864ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 128.385997ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
62062025-03-25T01:24:31.864ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 129.004516ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62072025-03-25T01:24:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62082025-03-25T01:24:31.867ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62092025-03-25T01:24:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62102025-03-25T01:24:31.867ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
62112025-03-25T01:24:31.867ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62122025-03-25T01:24:31.868ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a98d77a7-9159-422a-8a64-0ef91957c3c9", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
62132025-03-25T01:24:31.868ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62142025-03-25T01:24:31.869ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62152025-03-25T01:24:31.870ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62162025-03-25T01:24:31.870ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62172025-03-25T01:24:31.870ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62182025-03-25T01:24:31.871ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3427789f-41af-4815-9149-7dfde438575d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
62192025-03-25T01:24:31.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3427789f-41af-4815-9149-7dfde438575d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
62202025-03-25T01:24:31.874ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62212025-03-25T01:24:31.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62222025-03-25T01:24:31.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5575 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3427789f-41af-4815-9149-7dfde438575d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
62232025-03-25T01:24:31.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62242025-03-25T01:24:31.877ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62252025-03-25T01:24:31.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62262025-03-25T01:24:31.878ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62272025-03-25T01:24:31.883ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
62282025-03-25T01:24:31.883ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62292025-03-25T01:24:31.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62302025-03-25T01:24:31.886ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62312025-03-25T01:24:31.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62322025-03-25T01:24:31.889ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62332025-03-25T01:24:31.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62342025-03-25T01:24:31.902ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
62352025-03-25T01:24:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
62362025-03-25T01:24:31.903ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62372025-03-25T01:24:31.904ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62382025-03-25T01:24:31.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62392025-03-25T01:24:31.909ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62402025-03-25T01:24:31.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62412025-03-25T01:24:31.910ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62422025-03-25T01:24:31.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62432025-03-25T01:24:31.911ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62442025-03-25T01:24:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62452025-03-25T01:24:31.913ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62462025-03-25T01:24:31.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62472025-03-25T01:24:31.913ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62482025-03-25T01:24:31.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62492025-03-25T01:24:31.915ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
62502025-03-25T01:24:31.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
62512025-03-25T01:24:31.917ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62522025-03-25T01:24:31.917ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62532025-03-25T01:24:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62542025-03-25T01:24:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
62552025-03-25T01:24:31.919ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62562025-03-25T01:24:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62572025-03-25T01:24:31.921ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62582025-03-25T01:24:31.922ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 185.850869ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
62592025-03-25T01:24:31.922ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 186.823233ms iteration = 11 status = 0
62602025-03-25T01:24:31.922ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
62612025-03-25T01:24:31.923ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62622025-03-25T01:24:31.923ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3906f675-1371-4b02-b0c0-731b4a58289a", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
62632025-03-25T01:24:31.923ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62642025-03-25T01:24:31.924ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62652025-03-25T01:24:31.924ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62662025-03-25T01:24:31.924ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62672025-03-25T01:24:31.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62682025-03-25T01:24:31.925ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62692025-03-25T01:24:31.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62702025-03-25T01:24:31.926ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62712025-03-25T01:24:31.926ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
62722025-03-25T01:24:31.926ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62732025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62742025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62752025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62762025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 191.557581ms iteration = 13 status = {"physical_disks_added":0}
62772025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62782025-03-25T01:24:31.927ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62792025-03-25T01:24:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62802025-03-25T01:24:31.929ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62812025-03-25T01:24:31.929ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62822025-03-25T01:24:31.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
62832025-03-25T01:24:31.930ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
62842025-03-25T01:24:31.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
62852025-03-25T01:24:31.932ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
62862025-03-25T01:24:31.932ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
62872025-03-25T01:24:31.932ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
62882025-03-25T01:24:31.933ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
62892025-03-25T01:24:31.933ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 197.513236ms iteration = 11 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
62902025-03-25T01:24:31.933ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62912025-03-25T01:24:31.933ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62922025-03-25T01:24:31.934ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62932025-03-25T01:24:31.936ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62942025-03-25T01:24:31.936ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
62952025-03-25T01:24:31.936ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62962025-03-25T01:24:31.937ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62972025-03-25T01:24:31.938ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 202.468108ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
62982025-03-25T01:24:31.941ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62992025-03-25T01:24:31.941ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
63002025-03-25T01:24:31.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63012025-03-25T01:24:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63022025-03-25T01:24:31.943ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63032025-03-25T01:24:31.945ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
63042025-03-25T01:24:31.945ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 208.947699ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
63052025-03-25T01:24:31.946ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
63062025-03-25T01:24:31.946ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
63072025-03-25T01:24:31.946ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
63082025-03-25T01:24:31.946ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 210.182538ms iteration = 6 status = {"generation":2}
63092025-03-25T01:24:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
63102025-03-25T01:24:31.947ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
63112025-03-25T01:24:31.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
63122025-03-25T01:24:31.951ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
63132025-03-25T01:24:31.951ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 214.905285ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
63142025-03-25T01:24:31.951ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
63152025-03-25T01:24:31.957ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
63162025-03-25T01:24:31.957ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63172025-03-25T01:24:31.958ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16378913-2bea-44a6-88a0-686f9bc4e273", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
63182025-03-25T01:24:31.958ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63192025-03-25T01:24:31.960ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
63202025-03-25T01:24:31.960ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
63212025-03-25T01:24:31.960ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
63222025-03-25T01:24:31.960ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 224.397381ms iteration = 6 status = {"generation":1}
63232025-03-25T01:24:31.960ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
63242025-03-25T01:24:31.967ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63252025-03-25T01:24:31.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63262025-03-25T01:24:31.970ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63272025-03-25T01:24:31.973ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
63282025-03-25T01:24:31.973ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63292025-03-25T01:24:31.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63302025-03-25T01:24:31.986ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 249.732154ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
63312025-03-25T01:24:31.991ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63322025-03-25T01:24:31.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63332025-03-25T01:24:31.993ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63342025-03-25T01:24:31.993ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63352025-03-25T01:24:31.993ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 256.744144ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63362025-03-25T01:24:31.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63372025-03-25T01:24:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63382025-03-25T01:24:32.008ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
63392025-03-25T01:24:32.008ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 272.413708ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
63402025-03-25T01:24:32.031ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 295.304076ms iteration = 11 status = {}
63412025-03-25T01:24:32.164ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
63422025-03-25T01:24:32.188ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63432025-03-25T01:24:32.188ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63442025-03-25T01:24:32.188ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e74c81c8-01f6-4ea9-9934-4347effb0855", "content-length": "372", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
63452025-03-25T01:24:32.188ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63462025-03-25T01:24:32.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63472025-03-25T01:24:32.205ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
63482025-03-25T01:24:32.206ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d1c2f7b2-bd53-4e18-91a1-24c8d97b7b70", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63492025-03-25T01:24:32.206ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63502025-03-25T01:24:32.208ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "39c03c4b-1719-426b-9ae4-685fbb67d1f2", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63512025-03-25T01:24:32.208ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63522025-03-25T01:24:32.209ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
63532025-03-25T01:24:32.209ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
63542025-03-25T01:24:32.210ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 473.742639ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
63552025-03-25T01:24:32.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
63562025-03-25T01:24:32.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63572025-03-25T01:24:32.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63582025-03-25T01:24:32.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63592025-03-25T01:24:32.214ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63602025-03-25T01:24:32.214ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63612025-03-25T01:24:32.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63622025-03-25T01:24:32.214ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63632025-03-25T01:24:32.215ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63642025-03-25T01:24:32.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63652025-03-25T01:24:32.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
63662025-03-25T01:24:32.216ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
63672025-03-25T01:24:32.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
63682025-03-25T01:24:32.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63692025-03-25T01:24:32.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63702025-03-25T01:24:32.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63712025-03-25T01:24:32.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63722025-03-25T01:24:32.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
63732025-03-25T01:24:32.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
63742025-03-25T01:24:32.224ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63752025-03-25T01:24:32.225ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "42ce2618-eb33-453c-8fca-a938708dec58", "content-length": "1", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
63762025-03-25T01:24:32.226ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63772025-03-25T01:24:32.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63782025-03-25T01:24:32.228ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 492.953654ms iteration = 11 status = null
63792025-03-25T01:24:32.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63802025-03-25T01:24:32.245ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63812025-03-25T01:24:32.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63822025-03-25T01:24:32.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63832025-03-25T01:24:32.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63842025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
63852025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63862025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63872025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63882025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63892025-03-25T01:24:32.249ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1946907b-db29-476f-8f3c-d72cbf7ea6ba", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63902025-03-25T01:24:32.249ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63912025-03-25T01:24:32.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
63922025-03-25T01:24:32.251ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "be881ed9-cc71-4804-ae19-587ca0be3a9c", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63932025-03-25T01:24:32.251ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63942025-03-25T01:24:32.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63952025-03-25T01:24:32.256ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "ba38ea21-0935-47d8-a261-a2a01ff6b87a", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63962025-03-25T01:24:32.256ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
63972025-03-25T01:24:32.256ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
63982025-03-25T01:24:32.256ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
63992025-03-25T01:24:32.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64002025-03-25T01:24:32.257ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
64012025-03-25T01:24:32.257ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 521.616084ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
64022025-03-25T01:24:32.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64032025-03-25T01:24:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64042025-03-25T01:24:32.267ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64052025-03-25T01:24:32.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64062025-03-25T01:24:32.286ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64072025-03-25T01:24:32.286ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
64082025-03-25T01:24:32.286ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
64092025-03-25T01:24:32.286ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "db40c1ff-9b4e-4463-a602-319ae6fec682", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
64102025-03-25T01:24:32.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64112025-03-25T01:24:32.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64122025-03-25T01:24:32.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64132025-03-25T01:24:32.289ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64142025-03-25T01:24:32.292ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64152025-03-25T01:24:32.292ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64162025-03-25T01:24:32.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64172025-03-25T01:24:32.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64182025-03-25T01:24:32.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64192025-03-25T01:24:32.310ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64202025-03-25T01:24:32.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64212025-03-25T01:24:32.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64222025-03-25T01:24:32.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64232025-03-25T01:24:32.312ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64242025-03-25T01:24:32.315ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64252025-03-25T01:24:32.315ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64262025-03-25T01:24:32.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64272025-03-25T01:24:32.318ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
64282025-03-25T01:24:32.318ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
64292025-03-25T01:24:32.318ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c367d3c4-85da-4a9a-b079-b02ec094e895", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
64302025-03-25T01:24:32.320ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 584.517964ms iteration = 11 status = {}
64312025-03-25T01:24:32.325ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64322025-03-25T01:24:32.328ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64332025-03-25T01:24:32.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64342025-03-25T01:24:32.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
64352025-03-25T01:24:32.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64362025-03-25T01:24:32.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64372025-03-25T01:24:32.330ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64382025-03-25T01:24:32.332ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64392025-03-25T01:24:32.332ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64402025-03-25T01:24:32.333ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64412025-03-25T01:24:32.333ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64422025-03-25T01:24:32.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64432025-03-25T01:24:32.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64442025-03-25T01:24:32.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64452025-03-25T01:24:32.335ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64462025-03-25T01:24:32.341ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
64472025-03-25T01:24:32.341ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64482025-03-25T01:24:32.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64492025-03-25T01:24:32.343ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64502025-03-25T01:24:32.343ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64512025-03-25T01:24:32.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64522025-03-25T01:24:32.345ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64532025-03-25T01:24:32.346ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
64542025-03-25T01:24:32.346ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
64552025-03-25T01:24:32.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
64562025-03-25T01:24:32.347ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64572025-03-25T01:24:32.347ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64582025-03-25T01:24:32.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64592025-03-25T01:24:32.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64602025-03-25T01:24:32.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64612025-03-25T01:24:32.349ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64622025-03-25T01:24:32.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64632025-03-25T01:24:32.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64642025-03-25T01:24:32.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64652025-03-25T01:24:32.350ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
64662025-03-25T01:24:32.351ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "957ed837-483a-453f-906f-bebecaa9aa5a", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
64672025-03-25T01:24:32.351ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
64682025-03-25T01:24:32.351ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "b976074a-1b83-4a37-ba02-c49ea5a80ee0", "content-length": "26", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
64692025-03-25T01:24:32.354ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
64702025-03-25T01:24:32.358ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64712025-03-25T01:24:32.358ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
64722025-03-25T01:24:32.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64732025-03-25T01:24:32.359ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64742025-03-25T01:24:32.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64752025-03-25T01:24:32.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64762025-03-25T01:24:32.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64772025-03-25T01:24:32.363ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 627.116373ms iteration = 2 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:24:32.351556217Z"},{"operation":"list","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:24:32.354821944Z"}]}
64782025-03-25T01:24:32.364ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64792025-03-25T01:24:32.365ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64802025-03-25T01:24:32.365ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64812025-03-25T01:24:32.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64822025-03-25T01:24:32.366ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64832025-03-25T01:24:32.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64842025-03-25T01:24:32.368ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64852025-03-25T01:24:32.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64862025-03-25T01:24:32.369ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64872025-03-25T01:24:32.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64882025-03-25T01:24:32.371ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
64892025-03-25T01:24:32.371ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
64902025-03-25T01:24:32.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
64912025-03-25T01:24:32.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
64922025-03-25T01:24:32.373ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64932025-03-25T01:24:32.373ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64942025-03-25T01:24:32.374ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
64952025-03-25T01:24:32.375ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5af397a-eed8-42bb-81f9-09dd9fe01e57", "content-length": "134", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
64962025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
64972025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
64982025-03-25T01:24:32.375ZDEBGnexus (BackgroundTasks): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
64992025-03-25T01:24:32.375ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65002025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65012025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65022025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65032025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65042025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65052025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65062025-03-25T01:24:32.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65072025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65082025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65092025-03-25T01:24:32.375ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
65102025-03-25T01:24:32.375ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65112025-03-25T01:24:32.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65122025-03-25T01:24:32.378ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
65132025-03-25T01:24:32.378ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65142025-03-25T01:24:32.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65152025-03-25T01:24:32.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65162025-03-25T01:24:32.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a781559-c827-4ac6-afd1-05d59d130db0", "content-length": "2", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
65172025-03-25T01:24:32.378ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65182025-03-25T01:24:32.378ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d756439-53f2-4b0e-b418-e4bd07b5329b", "content-length": "51", "date": "Tue, 25 Mar 2025 01:24:31 GMT"} })
65192025-03-25T01:24:32.378ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
65202025-03-25T01:24:32.378ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
65212025-03-25T01:24:32.380ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65222025-03-25T01:24:32.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65232025-03-25T01:24:32.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65242025-03-25T01:24:32.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65252025-03-25T01:24:32.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65262025-03-25T01:24:32.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
65272025-03-25T01:24:32.386ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65282025-03-25T01:24:32.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65292025-03-25T01:24:32.386ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65302025-03-25T01:24:32.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65312025-03-25T01:24:32.389ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65322025-03-25T01:24:32.390ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65332025-03-25T01:24:32.390ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65342025-03-25T01:24:32.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65352025-03-25T01:24:32.392ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65362025-03-25T01:24:32.395ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
65372025-03-25T01:24:32.395ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
65382025-03-25T01:24:32.395ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
65392025-03-25T01:24:32.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65402025-03-25T01:24:32.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
65412025-03-25T01:24:32.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65422025-03-25T01:24:32.412ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65432025-03-25T01:24:32.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65442025-03-25T01:24:32.415ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
65452025-03-25T01:24:32.417ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 679.32176ms iteration = 4 status = {"blueprint_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","inventory_collection_id":"76fd242d-7bdf-4b4b-9ecd-c3e067117286","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":0,"num_already_tombstoned":0,"num_inserted":9,"num_not_in_inventory":0,"num_tombstoned":0}}}
65462025-03-25T01:24:32.417ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
65472025-03-25T01:24:32.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65482025-03-25T01:24:32.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65492025-03-25T01:24:32.418ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
65502025-03-25T01:24:32.418ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
65512025-03-25T01:24:32.418ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
65522025-03-25T01:24:32.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e28aabfd-ad08-422e-9a3a-a0c13281ac17", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
65532025-03-25T01:24:32.501ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
65542025-03-25T01:24:32.501ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
65552025-03-25T01:24:32.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bbdb8d9-27b2-41ec-8d29-95595b31e486", "content-length": "682", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
65562025-03-25T01:24:32.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65572025-03-25T01:24:32.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65582025-03-25T01:24:32.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65592025-03-25T01:24:32.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65602025-03-25T01:24:32.507ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0510bd75-84ab-4729-b050-1a792735d91a", "content-length": "691", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
65612025-03-25T01:24:32.507ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65622025-03-25T01:24:32.507ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65632025-03-25T01:24:32.507ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65642025-03-25T01:24:32.508ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 772.752668ms iteration = 11 status = {}
65652025-03-25T01:24:32.509ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65662025-03-25T01:24:32.509ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65672025-03-25T01:24:32.511ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65682025-03-25T01:24:32.511ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65692025-03-25T01:24:32.518ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 782.6749ms iteration = 11 status = {}
65702025-03-25T01:24:32.579ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, time_created: 2025-03-25T01:20:03.714241Z, time_modified: 2025-03-25T01:20:03.714241Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
65712025-03-25T01:24:32.579ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
65722025-03-25T01:24:32.579ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65732025-03-25T01:24:32.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65742025-03-25T01:24:32.584ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
65752025-03-25T01:24:32.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
65762025-03-25T01:24:32.585ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65772025-03-25T01:24:32.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
65782025-03-25T01:24:32.622ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
65792025-03-25T01:24:32.623ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "1a333fbd-a33e-4f8a-906c-a1f285a8aad2", "date": "Tue, 25 Mar 2025 01:24:32 GMT"} })
65802025-03-25T01:24:32.623ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
65812025-03-25T01:24:32.623ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 887.379737ms
65822025-03-25T01:24:32.623ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 887.387467ms iteration = 2 status = {}
65832025-03-25T01:24:32.910ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 977fa012-a420-4ad1-b561-a342563a3527 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65842025-03-25T01:24:32.911ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 977fa012-a420-4ad1-b561-a342563a3527 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65852025-03-25T01:24:32.913ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 977fa012-a420-4ad1-b561-a342563a3527 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65862025-03-25T01:24:33.933ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a928b7c-3ced-4ce8-a359-693d81b8d618 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65872025-03-25T01:24:33.934ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a928b7c-3ced-4ce8-a359-693d81b8d618 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65882025-03-25T01:24:33.936ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2399 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a928b7c-3ced-4ce8-a359-693d81b8d618 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65892025-03-25T01:24:34.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad645734-56f3-4170-88db-26fff5302f3a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65902025-03-25T01:24:34.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad645734-56f3-4170-88db-26fff5302f3a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65912025-03-25T01:24:34.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2614 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad645734-56f3-4170-88db-26fff5302f3a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65922025-03-25T01:24:35.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 507 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 6cde1754-c315-4ca7-a05d-1e210ff3e4ad response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
65932025-03-25T01:24:35.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 27f806dc-782e-4331-97d5-05218b57d636 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65942025-03-25T01:24:35.978ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 27f806dc-782e-4331-97d5-05218b57d636 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65952025-03-25T01:24:35.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2709 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 27f806dc-782e-4331-97d5-05218b57d636 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65962025-03-25T01:24:37.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5a73793-fa7b-463d-8dc9-20213f31c5a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65972025-03-25T01:24:37.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5a73793-fa7b-463d-8dc9-20213f31c5a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65982025-03-25T01:24:37.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2367 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a5a73793-fa7b-463d-8dc9-20213f31c5a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
65992025-03-25T01:24:38.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a4d634f7-bbbd-45a0-abe0-2b6a0be722f7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66002025-03-25T01:24:38.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a4d634f7-bbbd-45a0-abe0-2b6a0be722f7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66012025-03-25T01:24:38.027ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2627 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a4d634f7-bbbd-45a0-abe0-2b6a0be722f7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66022025-03-25T01:24:39.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9acf4ceb-7698-4cd5-9b14-160b53e6923e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66032025-03-25T01:24:39.048ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9acf4ceb-7698-4cd5-9b14-160b53e6923e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66042025-03-25T01:24:39.050ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9acf4ceb-7698-4cd5-9b14-160b53e6923e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66052025-03-25T01:24:40.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1058e352-c4d4-4f97-a0cd-64b55166ca30 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66062025-03-25T01:24:40.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1058e352-c4d4-4f97-a0cd-64b55166ca30 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66072025-03-25T01:24:40.073ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2294 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1058e352-c4d4-4f97-a0cd-64b55166ca30 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66082025-03-25T01:24:41.095ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db4f940c-99ec-4bc1-8d94-bce686171be7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66092025-03-25T01:24:41.095ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db4f940c-99ec-4bc1-8d94-bce686171be7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66102025-03-25T01:24:41.097ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2437 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db4f940c-99ec-4bc1-8d94-bce686171be7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66112025-03-25T01:24:41.735ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
66122025-03-25T01:24:41.735ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66132025-03-25T01:24:41.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66142025-03-25T01:24:41.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
66152025-03-25T01:24:41.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66162025-03-25T01:24:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66172025-03-25T01:24:41.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66182025-03-25T01:24:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66192025-03-25T01:24:41.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66202025-03-25T01:24:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66212025-03-25T01:24:41.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66222025-03-25T01:24:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66232025-03-25T01:24:41.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66242025-03-25T01:24:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
66252025-03-25T01:24:41.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66262025-03-25T01:24:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66272025-03-25T01:24:41.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
66282025-03-25T01:24:41.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.331286ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
66292025-03-25T01:24:41.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66302025-03-25T01:24:41.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66312025-03-25T01:24:41.797ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.49982ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66322025-03-25T01:24:42.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4703ce36-8e7b-4001-bfa5-f7076dbb6292 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66332025-03-25T01:24:42.118ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4703ce36-8e7b-4001-bfa5-f7076dbb6292 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66342025-03-25T01:24:42.120ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4703ce36-8e7b-4001-bfa5-f7076dbb6292 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66352025-03-25T01:24:43.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 90880d03-672e-4d0a-bcfe-990ccd45aefa roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66362025-03-25T01:24:43.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 90880d03-672e-4d0a-bcfe-990ccd45aefa resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66372025-03-25T01:24:43.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2224 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 90880d03-672e-4d0a-bcfe-990ccd45aefa response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66382025-03-25T01:24:44.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9916567a-fc6a-4562-ac34-ab48192e6378 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66392025-03-25T01:24:44.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9916567a-fc6a-4562-ac34-ab48192e6378 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66402025-03-25T01:24:44.165ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2219 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9916567a-fc6a-4562-ac34-ab48192e6378 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66412025-03-25T01:24:45.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8b5f85a9-d106-49d6-a206-f6c816f95b86 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66422025-03-25T01:24:45.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8b5f85a9-d106-49d6-a206-f6c816f95b86 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66432025-03-25T01:24:45.188ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8b5f85a9-d106-49d6-a206-f6c816f95b86 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66442025-03-25T01:24:45.755ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4d9b2926-e8ad-44a1-a4f7-ac92fb668814 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
66452025-03-25T01:24:45.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4d9b2926-e8ad-44a1-a4f7-ac92fb668814 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
66462025-03-25T01:24:45.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 4d9b2926-e8ad-44a1-a4f7-ac92fb668814 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
66472025-03-25T01:24:45.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 539eafa5-b6a4-4a8c-9b60-d56dd599c262 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
66482025-03-25T01:24:45.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 539eafa5-b6a4-4a8c-9b60-d56dd599c262 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
66492025-03-25T01:24:45.760ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2017 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 539eafa5-b6a4-4a8c-9b60-d56dd599c262 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
66502025-03-25T01:24:45.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 08fd84c8-5450-49f5-80f7-ed61dbdd0f6f response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
66512025-03-25T01:24:46.209ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76afa1ac-5a1a-486a-9e87-0932f4d2103f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66522025-03-25T01:24:46.209ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76afa1ac-5a1a-486a-9e87-0932f4d2103f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66532025-03-25T01:24:46.211ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 76afa1ac-5a1a-486a-9e87-0932f4d2103f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66542025-03-25T01:24:47.232ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1f111959-15c6-4ea7-9488-403dc35b44a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66552025-03-25T01:24:47.232ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1f111959-15c6-4ea7-9488-403dc35b44a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66562025-03-25T01:24:47.234ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1923 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1f111959-15c6-4ea7-9488-403dc35b44a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66572025-03-25T01:24:48.253ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afaa664e-4c95-4fca-84e1-270cb32a2b73 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66582025-03-25T01:24:48.254ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afaa664e-4c95-4fca-84e1-270cb32a2b73 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66592025-03-25T01:24:48.256ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afaa664e-4c95-4fca-84e1-270cb32a2b73 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66602025-03-25T01:24:49.277ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = df80a490-ef7b-48bf-8ceb-dde8b65f2452 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66612025-03-25T01:24:49.277ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = df80a490-ef7b-48bf-8ceb-dde8b65f2452 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66622025-03-25T01:24:49.279ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2449 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = df80a490-ef7b-48bf-8ceb-dde8b65f2452 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66632025-03-25T01:24:50.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d9a9deef-5553-4db8-ba69-6517affb352b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66642025-03-25T01:24:50.300ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d9a9deef-5553-4db8-ba69-6517affb352b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66652025-03-25T01:24:50.302ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2634 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d9a9deef-5553-4db8-ba69-6517affb352b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66662025-03-25T01:24:51.321ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 93e01301-54c1-4510-a8ac-a388d40d1ccf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66672025-03-25T01:24:51.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 93e01301-54c1-4510-a8ac-a388d40d1ccf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66682025-03-25T01:24:51.324ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2172 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 93e01301-54c1-4510-a8ac-a388d40d1ccf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66692025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
66702025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66712025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66722025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
66732025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66742025-03-25T01:24:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66752025-03-25T01:24:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66762025-03-25T01:24:51.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66772025-03-25T01:24:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66782025-03-25T01:24:51.740ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.770704ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66792025-03-25T01:24:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66802025-03-25T01:24:51.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66812025-03-25T01:24:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66822025-03-25T01:24:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66832025-03-25T01:24:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66842025-03-25T01:24:51.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66852025-03-25T01:24:51.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
66862025-03-25T01:24:51.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66872025-03-25T01:24:51.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66882025-03-25T01:24:51.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
66892025-03-25T01:24:51.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.88412ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
66902025-03-25T01:24:52.344ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f619d6e-55be-42d3-a249-7b68526c4664 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66912025-03-25T01:24:52.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f619d6e-55be-42d3-a249-7b68526c4664 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66922025-03-25T01:24:52.346ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2020 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9f619d6e-55be-42d3-a249-7b68526c4664 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66932025-03-25T01:24:53.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f686880-c866-479a-9836-6fdf82359a00 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66942025-03-25T01:24:53.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f686880-c866-479a-9836-6fdf82359a00 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66952025-03-25T01:24:53.370ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f686880-c866-479a-9836-6fdf82359a00 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66962025-03-25T01:24:54.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a168620e-3739-40fd-ade9-a245b2fe1da7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66972025-03-25T01:24:54.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a168620e-3739-40fd-ade9-a245b2fe1da7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66982025-03-25T01:24:54.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a168620e-3739-40fd-ade9-a245b2fe1da7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
66992025-03-25T01:24:55.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = caaf20fb-6a13-4e2d-9672-c9a419e8f365 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67002025-03-25T01:24:55.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = caaf20fb-6a13-4e2d-9672-c9a419e8f365 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67012025-03-25T01:24:55.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2120 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = caaf20fb-6a13-4e2d-9672-c9a419e8f365 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67022025-03-25T01:24:55.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 502 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 88884f52-e442-4743-bef8-e50b4bbdd341 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
67032025-03-25T01:24:56.435ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd83971-91dc-49a7-989c-41dbb70a2cc3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67042025-03-25T01:24:56.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd83971-91dc-49a7-989c-41dbb70a2cc3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67052025-03-25T01:24:56.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7dd83971-91dc-49a7-989c-41dbb70a2cc3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67062025-03-25T01:24:57.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6eb81a3b-7ff6-41e7-af38-2d98ba42a904 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67072025-03-25T01:24:57.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6eb81a3b-7ff6-41e7-af38-2d98ba42a904 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67082025-03-25T01:24:57.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2392 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6eb81a3b-7ff6-41e7-af38-2d98ba42a904 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67092025-03-25T01:24:58.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fb145c5-f89e-4f16-8871-aa3f93320d9d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67102025-03-25T01:24:58.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fb145c5-f89e-4f16-8871-aa3f93320d9d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67112025-03-25T01:24:58.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1726 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0fb145c5-f89e-4f16-8871-aa3f93320d9d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67122025-03-25T01:24:59.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5436b887-5e4b-438d-b0b6-2be1b9b2186d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67132025-03-25T01:24:59.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5436b887-5e4b-438d-b0b6-2be1b9b2186d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67142025-03-25T01:24:59.504ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2180 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5436b887-5e4b-438d-b0b6-2be1b9b2186d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67152025-03-25T01:25:00.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6102df78-65e8-4800-bc82-db1588a27b56 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67162025-03-25T01:25:00.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6102df78-65e8-4800-bc82-db1588a27b56 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67172025-03-25T01:25:00.528ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2373 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6102df78-65e8-4800-bc82-db1588a27b56 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67182025-03-25T01:25:01.550ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 907c7159-8f6d-439e-9081-ca3e5cb56b89 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67192025-03-25T01:25:01.551ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 907c7159-8f6d-439e-9081-ca3e5cb56b89 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67202025-03-25T01:25:01.553ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2511 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 907c7159-8f6d-439e-9081-ca3e5cb56b89 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
67212025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
67222025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
67232025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67242025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
67252025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67262025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67272025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 12 reason = Timeout
67282025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
67292025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
67302025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
67312025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
67322025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67332025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67342025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67352025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
67362025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
67372025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
67382025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67392025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
67402025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
67412025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
67422025-03-25T01:25:01.736ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
67432025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
67442025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67452025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
67462025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
67472025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67482025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
67492025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
67502025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
67512025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
67522025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
67532025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 12 reason = Timeout
67542025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
67552025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
67562025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
67572025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
67582025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
67592025-03-25T01:25:01.736ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
67602025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67612025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67622025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67632025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67642025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
67652025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67662025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67672025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67682025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67692025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
67702025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67712025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67722025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67732025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
67742025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
67752025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67762025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
67772025-03-25T01:25:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
67782025-03-25T01:25:01.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792025-03-25T01:25:01.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67802025-03-25T01:25:01.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67812025-03-25T01:25:01.740ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.16912ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67822025-03-25T01:25:01.741ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67832025-03-25T01:25:01.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
67842025-03-25T01:25:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67852025-03-25T01:25:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67862025-03-25T01:25:01.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67872025-03-25T01:25:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67882025-03-25T01:25:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
67892025-03-25T01:25:01.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
67902025-03-25T01:25:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67912025-03-25T01:25:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67922025-03-25T01:25:01.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67932025-03-25T01:25:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67942025-03-25T01:25:01.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 459764546 } })
67952025-03-25T01:25:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
67962025-03-25T01:25:01.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
67972025-03-25T01:25:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67982025-03-25T01:25:01.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
67992025-03-25T01:25:01.746ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 9.75087ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
68002025-03-25T01:25:01.746ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68012025-03-25T01:25:01.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68022025-03-25T01:25:01.747ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68032025-03-25T01:25:01.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 462659668 } })
68042025-03-25T01:25:01.748ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
68052025-03-25T01:25:01.749ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68062025-03-25T01:25:01.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68072025-03-25T01:25:01.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68082025-03-25T01:25:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68092025-03-25T01:25:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68102025-03-25T01:25:01.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68112025-03-25T01:25:01.753ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1205, tv_nsec: 468320289 } })
68122025-03-25T01:25:01.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68132025-03-25T01:25:01.754ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
68142025-03-25T01:25:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68152025-03-25T01:25:01.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68162025-03-25T01:25:01.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68172025-03-25T01:25:01.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68182025-03-25T01:25:01.758ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
68192025-03-25T01:25:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
68202025-03-25T01:25:01.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68212025-03-25T01:25:01.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
68222025-03-25T01:25:01.762ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
68232025-03-25T01:25:01.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
68242025-03-25T01:25:01.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68252025-03-25T01:25:01.805ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68262025-03-25T01:25:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68272025-03-25T01:25:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
68282025-03-25T01:25:01.806ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
68292025-03-25T01:25:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
68302025-03-25T01:25:01.807ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68312025-03-25T01:25:01.809ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68322025-03-25T01:25:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68332025-03-25T01:25:01.809ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
68342025-03-25T01:25:01.809ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68352025-03-25T01:25:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68362025-03-25T01:25:01.810ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.244873ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68372025-03-25T01:25:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 81.147852ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68382025-03-25T01:25:01.818ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68392025-03-25T01:25:01.818ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68402025-03-25T01:25:01.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 82.361109ms iteration = 12 status = {"errors":[],"finish_invoked_ok":[]}
68412025-03-25T01:25:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68422025-03-25T01:25:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
68432025-03-25T01:25:01.821ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68442025-03-25T01:25:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68452025-03-25T01:25:01.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 85.24106ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68462025-03-25T01:25:01.822ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68472025-03-25T01:25:01.822ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68482025-03-25T01:25:01.822ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68492025-03-25T01:25:01.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68502025-03-25T01:25:01.822ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68512025-03-25T01:25:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68522025-03-25T01:25:01.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68532025-03-25T01:25:01.825ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.055124ms iteration = 12 status = 0
68542025-03-25T01:25:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68552025-03-25T01:25:01.826ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68562025-03-25T01:25:01.826ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68572025-03-25T01:25:01.826ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68582025-03-25T01:25:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68592025-03-25T01:25:01.828ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
68602025-03-25T01:25:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
68612025-03-25T01:25:01.831ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68622025-03-25T01:25:01.832ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
68632025-03-25T01:25:01.832ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68642025-03-25T01:25:01.833ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1546f46b-5c6c-4bca-8d34-32259b099862", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
68652025-03-25T01:25:01.833ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68662025-03-25T01:25:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
68672025-03-25T01:25:01.833ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68682025-03-25T01:25:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68692025-03-25T01:25:01.835ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68702025-03-25T01:25:01.835ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68712025-03-25T01:25:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68722025-03-25T01:25:01.838ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 101.924069ms iteration = 12 status = {"errors":[],"requests_created_ok":[]}
68732025-03-25T01:25:01.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68742025-03-25T01:25:01.842ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68752025-03-25T01:25:01.842ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68762025-03-25T01:25:01.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68772025-03-25T01:25:01.845ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68782025-03-25T01:25:01.847ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
68792025-03-25T01:25:01.847ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
68802025-03-25T01:25:01.847ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
68812025-03-25T01:25:01.847ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68822025-03-25T01:25:01.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
68832025-03-25T01:25:01.848ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
68842025-03-25T01:25:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 111.588217ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
68852025-03-25T01:25:01.848ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d10b0cbb-5a19-4f64-bc12-30d214481fe1", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
68862025-03-25T01:25:01.848ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68872025-03-25T01:25:01.849ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
68882025-03-25T01:25:01.854ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
68892025-03-25T01:25:01.854ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
68902025-03-25T01:25:01.854ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "82e4fec4-c6bf-4d45-bfa0-94c477ed0264", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
68912025-03-25T01:25:01.854ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
68922025-03-25T01:25:01.857ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
68932025-03-25T01:25:01.875ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
68942025-03-25T01:25:01.876ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
68952025-03-25T01:25:01.877ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68962025-03-25T01:25:01.877ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 140.43979ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68972025-03-25T01:25:01.878ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982025-03-25T01:25:01.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.721668ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
68992025-03-25T01:25:01.879ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
69002025-03-25T01:25:01.879ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
69012025-03-25T01:25:01.879ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.032906ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
69022025-03-25T01:25:01.880ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
69032025-03-25T01:25:01.880ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
69042025-03-25T01:25:01.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
69052025-03-25T01:25:01.887ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 150.692537ms iteration = 14 status = {"physical_disks_added":0}
69062025-03-25T01:25:01.924ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
69072025-03-25T01:25:01.924ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 187.898678ms iteration = 12 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
69082025-03-25T01:25:01.945ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 209.418447ms iteration = 12 status = {}
69092025-03-25T01:25:01.960ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69102025-03-25T01:25:01.960ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "08411273-6597-4c93-b204-40c63a5e3ae4", "content-length": "1", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69112025-03-25T01:25:01.962ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69122025-03-25T01:25:01.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69132025-03-25T01:25:01.964ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 228.078824ms iteration = 12 status = null
69142025-03-25T01:25:01.990ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69152025-03-25T01:25:01.990ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69162025-03-25T01:25:01.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "90b34cb9-84fd-4c84-934e-6a968b15ea03", "content-length": "372", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69172025-03-25T01:25:01.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69182025-03-25T01:25:01.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69192025-03-25T01:25:02.007ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
69202025-03-25T01:25:02.008ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f565884-bdcb-436f-9bd0-0b0b4cd76c93", "content-length": "691", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69212025-03-25T01:25:02.008ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
69222025-03-25T01:25:02.008ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
69232025-03-25T01:25:02.008ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
69242025-03-25T01:25:02.010ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 273.848979ms iteration = 12 status = {}
69252025-03-25T01:25:02.049ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69262025-03-25T01:25:02.049ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69272025-03-25T01:25:02.049ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "28410dea-b823-44ec-bfa1-24782800940d", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69282025-03-25T01:25:02.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69292025-03-25T01:25:02.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69302025-03-25T01:25:02.052ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69312025-03-25T01:25:02.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69322025-03-25T01:25:02.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69332025-03-25T01:25:02.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69342025-03-25T01:25:02.064ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69352025-03-25T01:25:02.064ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69362025-03-25T01:25:02.065ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "cc59436e-68ea-4274-ac31-3fde44fc25df", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69372025-03-25T01:25:02.068ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 331.389982ms iteration = 12 status = {}
69382025-03-25T01:25:02.097ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69392025-03-25T01:25:02.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69402025-03-25T01:25:02.100ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
69412025-03-25T01:25:02.100ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69422025-03-25T01:25:02.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69432025-03-25T01:25:02.113ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69442025-03-25T01:25:02.113ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e48a61e7-a3a8-4c94-8a3a-4c9ee7e0818f", "content-length": "134", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69452025-03-25T01:25:02.113ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69462025-03-25T01:25:02.113ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
69472025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69482025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69492025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69502025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69512025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69522025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69532025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69542025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69552025-03-25T01:25:02.114ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
69562025-03-25T01:25:02.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69572025-03-25T01:25:02.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69582025-03-25T01:25:02.115ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69592025-03-25T01:25:02.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "140c28ef-3b99-483f-889b-03eb403a6794", "content-length": "2", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69602025-03-25T01:25:02.116ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69612025-03-25T01:25:02.116ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "071d3dae-3042-455c-8fa8-51a1a674bde0", "content-length": "51", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69622025-03-25T01:25:02.116ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
69632025-03-25T01:25:02.116ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69642025-03-25T01:25:02.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9cde8cde-6364-4108-a7d6-9f8eb0b7b333", "date": "Tue, 25 Mar 2025 01:25:01 GMT"} })
69652025-03-25T01:25:02.219ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
69662025-03-25T01:25:02.219ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
69672025-03-25T01:25:02.219ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "79d0e810-0ac0-47e1-b97c-a95af801943f", "content-length": "682", "date": "Tue, 25 Mar 2025 01:25:02 GMT"} })
69682025-03-25T01:25:02.219ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69692025-03-25T01:25:02.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69702025-03-25T01:25:02.223ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69712025-03-25T01:25:02.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69722025-03-25T01:25:02.227ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69732025-03-25T01:25:02.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69742025-03-25T01:25:02.229ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69752025-03-25T01:25:02.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69762025-03-25T01:25:02.236ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 499.970445ms iteration = 12 status = {}
69772025-03-25T01:25:02.572ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9b1464f4-a4a0-4bac-b08f-c912bdf14274 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69782025-03-25T01:25:02.572ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9b1464f4-a4a0-4bac-b08f-c912bdf14274 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69792025-03-25T01:25:02.574ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2446 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9b1464f4-a4a0-4bac-b08f-c912bdf14274 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69802025-03-25T01:25:03.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ab58ac9-cede-490a-bba8-91f8698d498b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69812025-03-25T01:25:03.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ab58ac9-cede-490a-bba8-91f8698d498b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69822025-03-25T01:25:03.596ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2029 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ab58ac9-cede-490a-bba8-91f8698d498b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69832025-03-25T01:25:04.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ed3db4cd-6e6b-4023-8b60-6eb134bb298e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69842025-03-25T01:25:04.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ed3db4cd-6e6b-4023-8b60-6eb134bb298e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69852025-03-25T01:25:04.618ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2486 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ed3db4cd-6e6b-4023-8b60-6eb134bb298e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69862025-03-25T01:25:05.638ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 776f76a2-4314-4629-975d-3e165e38230a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69872025-03-25T01:25:05.638ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 776f76a2-4314-4629-975d-3e165e38230a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69882025-03-25T01:25:05.640ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2078 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 776f76a2-4314-4629-975d-3e165e38230a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69892025-03-25T01:25:05.762ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 495 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = d4ddde12-2c65-4d62-b721-d54694690b41 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
69902025-03-25T01:25:06.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 644ea663-750a-4604-88b5-ad139ed711ac roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69912025-03-25T01:25:06.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 644ea663-750a-4604-88b5-ad139ed711ac resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69922025-03-25T01:25:06.662ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2756 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 644ea663-750a-4604-88b5-ad139ed711ac response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69932025-03-25T01:25:07.682ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a52e27db-6914-4003-9663-44d94864e1ca roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69942025-03-25T01:25:07.683ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a52e27db-6914-4003-9663-44d94864e1ca resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69952025-03-25T01:25:07.685ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2217 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a52e27db-6914-4003-9663-44d94864e1ca response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69962025-03-25T01:25:08.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f31e1b6d-2197-418a-92d7-5d59a50fe2fd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69972025-03-25T01:25:08.703ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f31e1b6d-2197-418a-92d7-5d59a50fe2fd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69982025-03-25T01:25:08.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1950 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f31e1b6d-2197-418a-92d7-5d59a50fe2fd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
69992025-03-25T01:25:09.726ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a52cad-51ec-4f01-b45e-61381380738e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70002025-03-25T01:25:09.726ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a52cad-51ec-4f01-b45e-61381380738e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70012025-03-25T01:25:09.728ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2729 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a52cad-51ec-4f01-b45e-61381380738e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70022025-03-25T01:25:10.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1926c133-8cd0-491a-acf8-80e3be88cbc7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70032025-03-25T01:25:10.751ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1926c133-8cd0-491a-acf8-80e3be88cbc7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70042025-03-25T01:25:10.753ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1926c133-8cd0-491a-acf8-80e3be88cbc7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70052025-03-25T01:25:11.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
70062025-03-25T01:25:11.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70072025-03-25T01:25:11.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70082025-03-25T01:25:11.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
70092025-03-25T01:25:11.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70102025-03-25T01:25:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70112025-03-25T01:25:11.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70122025-03-25T01:25:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70132025-03-25T01:25:11.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70142025-03-25T01:25:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70152025-03-25T01:25:11.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70162025-03-25T01:25:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70172025-03-25T01:25:11.768ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70182025-03-25T01:25:11.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70192025-03-25T01:25:11.774ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b8d784-2c6c-4b95-91fc-968cdb879626 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70202025-03-25T01:25:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70212025-03-25T01:25:11.774ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b8d784-2c6c-4b95-91fc-968cdb879626 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70222025-03-25T01:25:11.776ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2006 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b8d784-2c6c-4b95-91fc-968cdb879626 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70232025-03-25T01:25:11.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
70242025-03-25T01:25:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70252025-03-25T01:25:11.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70262025-03-25T01:25:11.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
70272025-03-25T01:25:11.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.537729ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
70282025-03-25T01:25:11.798ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.924246ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70292025-03-25T01:25:12.796ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b1decc51-21d7-4f4b-b883-1b5e92918bcd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70302025-03-25T01:25:12.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b1decc51-21d7-4f4b-b883-1b5e92918bcd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70312025-03-25T01:25:12.798ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2122 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b1decc51-21d7-4f4b-b883-1b5e92918bcd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70322025-03-25T01:25:13.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 213a7c3b-50c4-400f-a8ab-30022502ffc2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70332025-03-25T01:25:13.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 213a7c3b-50c4-400f-a8ab-30022502ffc2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70342025-03-25T01:25:13.820ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2256 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 213a7c3b-50c4-400f-a8ab-30022502ffc2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70352025-03-25T01:25:14.839ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c19dbe1-4e8b-4969-abc4-6457d8ae1d29 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70362025-03-25T01:25:14.840ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c19dbe1-4e8b-4969-abc4-6457d8ae1d29 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70372025-03-25T01:25:14.841ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c19dbe1-4e8b-4969-abc4-6457d8ae1d29 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70382025-03-25T01:25:15.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = a35834f4-ccbd-44b4-8295-f4859e6b839e roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
70392025-03-25T01:25:15.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = a35834f4-ccbd-44b4-8295-f4859e6b839e resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
70402025-03-25T01:25:15.758ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2669 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = a35834f4-ccbd-44b4-8295-f4859e6b839e response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
70412025-03-25T01:25:15.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = af32ccd4-8b52-46f9-8744-35a1fa2a7e1f roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
70422025-03-25T01:25:15.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = af32ccd4-8b52-46f9-8744-35a1fa2a7e1f resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
70432025-03-25T01:25:15.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = af32ccd4-8b52-46f9-8744-35a1fa2a7e1f response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
70442025-03-25T01:25:15.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 406 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 263a5898-296b-49e3-a89c-c8939b668e0f response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
70452025-03-25T01:25:15.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 777cb133-4169-4ffc-828d-30b6eb5a90ef roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70462025-03-25T01:25:15.861ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 777cb133-4169-4ffc-828d-30b6eb5a90ef resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70472025-03-25T01:25:15.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2059 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 777cb133-4169-4ffc-828d-30b6eb5a90ef response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70482025-03-25T01:25:16.883ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 45b67b81-29b4-46e6-a5af-4df15ca54715 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70492025-03-25T01:25:16.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 45b67b81-29b4-46e6-a5af-4df15ca54715 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70502025-03-25T01:25:16.885ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1871 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 45b67b81-29b4-46e6-a5af-4df15ca54715 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70512025-03-25T01:25:17.904ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 72bead02-cd43-453b-9620-a06d59dd8707 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70522025-03-25T01:25:17.905ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 72bead02-cd43-453b-9620-a06d59dd8707 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70532025-03-25T01:25:17.907ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2194 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 72bead02-cd43-453b-9620-a06d59dd8707 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70542025-03-25T01:25:18.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50a92bf2-7fd2-456d-911d-e6380bd2300e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70552025-03-25T01:25:18.928ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50a92bf2-7fd2-456d-911d-e6380bd2300e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70562025-03-25T01:25:18.930ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50a92bf2-7fd2-456d-911d-e6380bd2300e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70572025-03-25T01:25:19.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9c17282-87a9-43c4-b291-aa68c25d4444 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70582025-03-25T01:25:19.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9c17282-87a9-43c4-b291-aa68c25d4444 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70592025-03-25T01:25:19.952ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1916 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9c17282-87a9-43c4-b291-aa68c25d4444 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70602025-03-25T01:25:20.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9cc98ef1-e42f-47cf-8c58-d6408a26a4fb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70612025-03-25T01:25:20.973ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9cc98ef1-e42f-47cf-8c58-d6408a26a4fb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70622025-03-25T01:25:20.975ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2267 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9cc98ef1-e42f-47cf-8c58-d6408a26a4fb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70632025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
70642025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70652025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70662025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
70672025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70682025-03-25T01:25:21.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70692025-03-25T01:25:21.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70702025-03-25T01:25:21.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70712025-03-25T01:25:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70722025-03-25T01:25:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70732025-03-25T01:25:21.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70742025-03-25T01:25:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70752025-03-25T01:25:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70762025-03-25T01:25:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70772025-03-25T01:25:21.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70782025-03-25T01:25:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
70792025-03-25T01:25:21.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70802025-03-25T01:25:21.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70812025-03-25T01:25:21.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
70822025-03-25T01:25:21.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.912609ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
70832025-03-25T01:25:21.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.383938ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70842025-03-25T01:25:21.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd6032d8-5f9d-49d3-85fe-6fe7e46b5d6b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70852025-03-25T01:25:21.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd6032d8-5f9d-49d3-85fe-6fe7e46b5d6b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70862025-03-25T01:25:21.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1766 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bd6032d8-5f9d-49d3-85fe-6fe7e46b5d6b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70872025-03-25T01:25:23.021ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a83980f6-9d7b-414d-ab0a-559ac6c96ba1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70882025-03-25T01:25:23.021ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a83980f6-9d7b-414d-ab0a-559ac6c96ba1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70892025-03-25T01:25:23.023ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1896 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a83980f6-9d7b-414d-ab0a-559ac6c96ba1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70902025-03-25T01:25:24.043ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7d6cbca1-a6b0-42d9-96e6-347c24391c83 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70912025-03-25T01:25:24.043ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7d6cbca1-a6b0-42d9-96e6-347c24391c83 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70922025-03-25T01:25:24.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7d6cbca1-a6b0-42d9-96e6-347c24391c83 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70932025-03-25T01:25:25.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3799a21d-7e29-4f5f-9db5-58d3cbac9d8e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70942025-03-25T01:25:25.064ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3799a21d-7e29-4f5f-9db5-58d3cbac9d8e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70952025-03-25T01:25:25.066ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2500 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3799a21d-7e29-4f5f-9db5-58d3cbac9d8e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70962025-03-25T01:25:25.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 401 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 54bac165-0610-49af-90e4-3d0cb0fb98ed response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
70972025-03-25T01:25:26.085ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 85ac06d5-e7b3-4e49-b19c-8abb4f3fd750 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70982025-03-25T01:25:26.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 85ac06d5-e7b3-4e49-b19c-8abb4f3fd750 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
70992025-03-25T01:25:26.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2477 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 85ac06d5-e7b3-4e49-b19c-8abb4f3fd750 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71002025-03-25T01:25:27.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20a795bc-bea5-432c-a60f-30b8efc05dbc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71012025-03-25T01:25:27.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20a795bc-bea5-432c-a60f-30b8efc05dbc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71022025-03-25T01:25:27.112ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2658 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20a795bc-bea5-432c-a60f-30b8efc05dbc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71032025-03-25T01:25:28.133ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e55fdfc-fd30-41ee-a7da-c66f3f00f4ff roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71042025-03-25T01:25:28.133ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e55fdfc-fd30-41ee-a7da-c66f3f00f4ff resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71052025-03-25T01:25:28.135ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1820 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e55fdfc-fd30-41ee-a7da-c66f3f00f4ff response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71062025-03-25T01:25:29.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c073e7-740c-48a1-9ac6-b539a23a549f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71072025-03-25T01:25:29.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c073e7-740c-48a1-9ac6-b539a23a549f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71082025-03-25T01:25:29.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2257 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c073e7-740c-48a1-9ac6-b539a23a549f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71092025-03-25T01:25:30.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35274bca-b47d-4f99-8335-a319c8bdac75 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71102025-03-25T01:25:30.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35274bca-b47d-4f99-8335-a319c8bdac75 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71112025-03-25T01:25:30.180ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35274bca-b47d-4f99-8335-a319c8bdac75 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71122025-03-25T01:25:30.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = c0246e4b-ecf5-4aa1-b0d5-a61b5c721c92 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
71132025-03-25T01:25:30.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = c0246e4b-ecf5-4aa1-b0d5-a61b5c721c92 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
71142025-03-25T01:25:30.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = c0246e4b-ecf5-4aa1-b0d5-a61b5c721c92 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
71152025-03-25T01:25:30.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 98599124-7561-472d-8d17-8d48ed72fe4c roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
71162025-03-25T01:25:30.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 98599124-7561-472d-8d17-8d48ed72fe4c resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
71172025-03-25T01:25:30.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 98599124-7561-472d-8d17-8d48ed72fe4c response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
71182025-03-25T01:25:31.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 034965f2-ea40-4d55-ad8f-bfe5cd5299f3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71192025-03-25T01:25:31.202ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 034965f2-ea40-4d55-ad8f-bfe5cd5299f3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71202025-03-25T01:25:31.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 034965f2-ea40-4d55-ad8f-bfe5cd5299f3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
71212025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
71222025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71232025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
71242025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
71252025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71262025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
71272025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
71282025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 13 reason = Timeout
71292025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
71302025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
71312025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
71322025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
71332025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
71342025-03-25T01:25:31.736ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
71352025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
71362025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.93\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
71372025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
71382025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
71392025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
71402025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
71412025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71422025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
71432025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71442025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
71452025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
71462025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
71472025-03-25T01:25:31.736ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
71482025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
71492025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
71502025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
71512025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
71522025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71532025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
71542025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71552025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
71562025-03-25T01:25:31.736ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:15:31.736450583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
71572025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
71582025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
71592025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
71602025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
71612025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
71622025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
71632025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71642025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71652025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
71662025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71672025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
71682025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71692025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
71702025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
71712025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
71722025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71732025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71742025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
71752025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71762025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
71772025-03-25T01:25:31.736ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
71782025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
71792025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
71802025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
71812025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
71822025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
71832025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
71842025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
71852025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
71862025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71872025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
71882025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71892025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
71902025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
71912025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71922025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71932025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
71942025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
71952025-03-25T01:25:31.737ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
71962025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
71972025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71982025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 13 reason = Timeout
71992025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
72002025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
72012025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72022025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
72032025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72042025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
72052025-03-25T01:25:31.737ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 451392897 } })
72062025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72072025-03-25T01:25:31.737ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 451418947 } })
72082025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72092025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
72102025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72112025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72122025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72132025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
72142025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72152025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72162025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
72172025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72182025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72192025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72202025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72212025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72222025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72232025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72242025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72252025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
72262025-03-25T01:25:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.616723ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
72272025-03-25T01:25:31.738ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
72282025-03-25T01:25:31.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.805236ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
72292025-03-25T01:25:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72302025-03-25T01:25:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72312025-03-25T01:25:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.383558ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72322025-03-25T01:25:31.739ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72332025-03-25T01:25:31.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72342025-03-25T01:25:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72352025-03-25T01:25:31.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72362025-03-25T01:25:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
72372025-03-25T01:25:31.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72382025-03-25T01:25:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72392025-03-25T01:25:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
72402025-03-25T01:25:31.742ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
72412025-03-25T01:25:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
72422025-03-25T01:25:31.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72432025-03-25T01:25:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
72442025-03-25T01:25:31.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72452025-03-25T01:25:31.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 457796538 } })
72462025-03-25T01:25:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72472025-03-25T01:25:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72482025-03-25T01:25:31.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
72492025-03-25T01:25:31.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72502025-03-25T01:25:31.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72512025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
72522025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72532025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72542025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
72552025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72562025-03-25T01:25:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72572025-03-25T01:25:31.753ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:15:31.736450583 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
72582025-03-25T01:25:31.753ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 17.270777ms iteration = 7 status = {"expiration":"2025-03-25T01:15:31.736450583Z","pruned":[]}
72592025-03-25T01:25:31.754ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 468980308 } })
72602025-03-25T01:25:31.755ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
72612025-03-25T01:25:31.756ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.440919ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
72622025-03-25T01:25:31.757ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72632025-03-25T01:25:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72642025-03-25T01:25:31.762ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72652025-03-25T01:25:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72662025-03-25T01:25:31.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72672025-03-25T01:25:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
72682025-03-25T01:25:31.773ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72692025-03-25T01:25:31.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72702025-03-25T01:25:31.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72712025-03-25T01:25:31.778ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 41.338651ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
72722025-03-25T01:25:31.780ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
72732025-03-25T01:25:31.780ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72742025-03-25T01:25:31.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72752025-03-25T01:25:31.785ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72762025-03-25T01:25:31.788ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72772025-03-25T01:25:31.788ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72782025-03-25T01:25:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72792025-03-25T01:25:31.796ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1235, tv_nsec: 510311809 } })
72802025-03-25T01:25:31.796ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
72812025-03-25T01:25:31.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72822025-03-25T01:25:31.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72832025-03-25T01:25:31.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72842025-03-25T01:25:31.822ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72852025-03-25T01:25:31.824ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72862025-03-25T01:25:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72872025-03-25T01:25:31.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
72882025-03-25T01:25:31.825ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72892025-03-25T01:25:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72902025-03-25T01:25:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
72912025-03-25T01:25:31.826ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
72922025-03-25T01:25:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
72932025-03-25T01:25:31.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72942025-03-25T01:25:31.830ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72952025-03-25T01:25:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72962025-03-25T01:25:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72972025-03-25T01:25:31.833ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72982025-03-25T01:25:31.835ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72992025-03-25T01:25:31.835ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73002025-03-25T01:25:31.835ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73012025-03-25T01:25:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73022025-03-25T01:25:31.836ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 99.598736ms iteration = 13 status = {"errors":[],"finish_invoked_ok":[]}
73032025-03-25T01:25:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
73042025-03-25T01:25:31.837ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73052025-03-25T01:25:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73062025-03-25T01:25:31.843ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73072025-03-25T01:25:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73082025-03-25T01:25:31.846ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73092025-03-25T01:25:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73102025-03-25T01:25:31.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73112025-03-25T01:25:31.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73122025-03-25T01:25:31.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73132025-03-25T01:25:31.851ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142025-03-25T01:25:31.852ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73152025-03-25T01:25:31.852ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
73162025-03-25T01:25:31.852ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
73172025-03-25T01:25:31.852ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 115.31507ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
73182025-03-25T01:25:31.854ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 117.050486ms iteration = 13 status = {"errors":[],"requests_created_ok":[]}
73192025-03-25T01:25:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73202025-03-25T01:25:31.854ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73212025-03-25T01:25:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73222025-03-25T01:25:31.856ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73232025-03-25T01:25:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73242025-03-25T01:25:31.856ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73252025-03-25T01:25:31.859ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73262025-03-25T01:25:31.859ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73272025-03-25T01:25:31.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73282025-03-25T01:25:31.862ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292025-03-25T01:25:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
73302025-03-25T01:25:31.867ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73312025-03-25T01:25:31.867ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73322025-03-25T01:25:31.868ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332025-03-25T01:25:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
73342025-03-25T01:25:31.871ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
73352025-03-25T01:25:31.871ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
73362025-03-25T01:25:31.874ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 136.98735ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73372025-03-25T01:25:31.875ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73382025-03-25T01:25:31.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
73392025-03-25T01:25:31.878ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 141.87193ms iteration = 4 status = {"nsuccess":5}
73402025-03-25T01:25:31.879ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73412025-03-25T01:25:31.879ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73422025-03-25T01:25:31.879ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73432025-03-25T01:25:31.882ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
73442025-03-25T01:25:31.882ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73452025-03-25T01:25:31.883ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e90ef7-875e-42ff-a4dd-e2a6c8ce75a4", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:31 GMT"} })
73462025-03-25T01:25:31.883ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73472025-03-25T01:25:31.885ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73482025-03-25T01:25:31.886ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73492025-03-25T01:25:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
73502025-03-25T01:25:31.889ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
73512025-03-25T01:25:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
73522025-03-25T01:25:31.905ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73532025-03-25T01:25:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73542025-03-25T01:25:31.907ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73552025-03-25T01:25:31.908ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73562025-03-25T01:25:31.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73572025-03-25T01:25:31.910ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73582025-03-25T01:25:31.910ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73592025-03-25T01:25:31.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73602025-03-25T01:25:31.912ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73612025-03-25T01:25:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
73622025-03-25T01:25:31.917ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73632025-03-25T01:25:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73642025-03-25T01:25:31.918ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
73652025-03-25T01:25:31.918ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 182.119366ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
73662025-03-25T01:25:31.918ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
73672025-03-25T01:25:31.918ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34b4ada9-e4aa-4016-823a-937f55e89f2a", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:31 GMT"} })
73682025-03-25T01:25:31.918ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
73692025-03-25T01:25:31.919ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
73702025-03-25T01:25:31.921ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 185.292252ms iteration = 13 status = 0
73712025-03-25T01:25:31.922ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
73722025-03-25T01:25:31.923ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73732025-03-25T01:25:31.924ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73742025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73752025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73762025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73772025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73782025-03-25T01:25:31.925ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
73792025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73802025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 188.67436ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
73812025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73822025-03-25T01:25:31.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
73832025-03-25T01:25:31.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73842025-03-25T01:25:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
73852025-03-25T01:25:31.928ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73862025-03-25T01:25:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73872025-03-25T01:25:31.935ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 198.249017ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
73882025-03-25T01:25:31.936ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73892025-03-25T01:25:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73902025-03-25T01:25:31.941ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73912025-03-25T01:25:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73922025-03-25T01:25:31.945ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73932025-03-25T01:25:31.945ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
73942025-03-25T01:25:31.948ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73952025-03-25T01:25:31.948ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
73962025-03-25T01:25:31.948ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
73972025-03-25T01:25:31.948ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 211.807341ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
73982025-03-25T01:25:31.951ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
73992025-03-25T01:25:31.951ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74002025-03-25T01:25:31.951ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74012025-03-25T01:25:31.951ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 214.429519ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74022025-03-25T01:25:31.954ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
74032025-03-25T01:25:31.954ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 217.971199ms iteration = 13 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
74042025-03-25T01:25:31.956ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
74052025-03-25T01:25:31.956ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 219.792965ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
74062025-03-25T01:25:31.960ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74072025-03-25T01:25:31.961ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74082025-03-25T01:25:31.967ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74092025-03-25T01:25:31.967ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74102025-03-25T01:25:31.967ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74112025-03-25T01:25:31.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74122025-03-25T01:25:31.970ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74132025-03-25T01:25:31.970ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74142025-03-25T01:25:31.970ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74152025-03-25T01:25:31.970ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74162025-03-25T01:25:31.970ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74172025-03-25T01:25:31.989ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
74182025-03-25T01:25:31.989ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 253.432547ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74192025-03-25T01:25:31.997ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
74202025-03-25T01:25:31.997ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 260.828302ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
74212025-03-25T01:25:31.998ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
74222025-03-25T01:25:31.998ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74232025-03-25T01:25:31.999ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "73723cc8-4ae4-4ff3-a886-92f9d141f180", "content-length": "26", "date": "Tue, 25 Mar 2025 01:25:31 GMT"} })
74242025-03-25T01:25:31.999ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74252025-03-25T01:25:32.000ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
74262025-03-25T01:25:32.000ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
74272025-03-25T01:25:32.000ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
74282025-03-25T01:25:32.000ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74292025-03-25T01:25:32.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74302025-03-25T01:25:32.002ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74312025-03-25T01:25:32.007ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74322025-03-25T01:25:32.007ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74332025-03-25T01:25:32.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74342025-03-25T01:25:32.010ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
74352025-03-25T01:25:32.010ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
74362025-03-25T01:25:32.010ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
74372025-03-25T01:25:32.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 274.526488ms iteration = 7 status = {"generation":1}
74382025-03-25T01:25:32.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74392025-03-25T01:25:32.020ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74402025-03-25T01:25:32.020ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74412025-03-25T01:25:32.020ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 283.869492ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74422025-03-25T01:25:32.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74432025-03-25T01:25:32.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74442025-03-25T01:25:32.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74452025-03-25T01:25:32.064ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74462025-03-25T01:25:32.064ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
74472025-03-25T01:25:32.064ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74482025-03-25T01:25:32.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74492025-03-25T01:25:32.080ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 344.261546ms iteration = 15 status = {"physical_disks_added":0}
74502025-03-25T01:25:32.085ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74512025-03-25T01:25:32.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74522025-03-25T01:25:32.109ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74532025-03-25T01:25:32.110ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "43cfb49c-22e0-4898-9827-ca614d8d1622", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74542025-03-25T01:25:32.110ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74552025-03-25T01:25:32.112ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6e9ff037-cc19-4eae-bfc2-9a32433c1052", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74562025-03-25T01:25:32.112ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74572025-03-25T01:25:32.114ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
74582025-03-25T01:25:32.114ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 377.884317ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
74592025-03-25T01:25:32.119ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
74602025-03-25T01:25:32.119ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c843303-487e-4fdc-a105-8513109572bd", "content-length": "1", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
74612025-03-25T01:25:32.121ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
74622025-03-25T01:25:32.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
74632025-03-25T01:25:32.151ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 414.672713ms iteration = 13 status = {}
74642025-03-25T01:25:32.157ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
74652025-03-25T01:25:32.172ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
74662025-03-25T01:25:32.172ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74672025-03-25T01:25:32.172ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9d819aeb-9fcc-44a5-aedd-4631e80854cf", "content-length": "372", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
74682025-03-25T01:25:32.172ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74692025-03-25T01:25:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74702025-03-25T01:25:32.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74712025-03-25T01:25:32.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74722025-03-25T01:25:32.176ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 439.668712ms iteration = 13 status = null
74732025-03-25T01:25:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74742025-03-25T01:25:32.177ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74752025-03-25T01:25:32.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74762025-03-25T01:25:32.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74772025-03-25T01:25:32.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74782025-03-25T01:25:32.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74792025-03-25T01:25:32.180ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74802025-03-25T01:25:32.180ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
74812025-03-25T01:25:32.180ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
74822025-03-25T01:25:32.180ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
74832025-03-25T01:25:32.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 444.025354ms iteration = 7 status = {"generation":2}
74842025-03-25T01:25:32.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
74852025-03-25T01:25:32.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74862025-03-25T01:25:32.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74872025-03-25T01:25:32.189ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
74882025-03-25T01:25:32.189ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
74892025-03-25T01:25:32.189ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "45a3019b-e883-4fd1-9635-482f8036651c", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
74902025-03-25T01:25:32.189ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74912025-03-25T01:25:32.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74922025-03-25T01:25:32.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74932025-03-25T01:25:32.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74942025-03-25T01:25:32.194ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74952025-03-25T01:25:32.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74962025-03-25T01:25:32.197ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
74972025-03-25T01:25:32.197ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
74982025-03-25T01:25:32.198ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2ae6117c-9fbe-4bd9-9236-5aadeaa5706b", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
74992025-03-25T01:25:32.200ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 463.396521ms iteration = 13 status = {}
75002025-03-25T01:25:32.214ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75012025-03-25T01:25:32.215ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5e4faa68-1814-40bc-afd4-c3c4428a1b50", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75022025-03-25T01:25:32.215ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75032025-03-25T01:25:32.216ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "67159a5d-df17-4c68-b31f-de790c7e7587", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75042025-03-25T01:25:32.216ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75052025-03-25T01:25:32.218ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "67a21a51-15ec-4175-9810-595be229cc2b", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75062025-03-25T01:25:32.218ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75072025-03-25T01:25:32.220ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75082025-03-25T01:25:32.220ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 484.167178ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75092025-03-25T01:25:32.225ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c947f50-2240-4ace-bf26-b967ed52abf7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75102025-03-25T01:25:32.226ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c947f50-2240-4ace-bf26-b967ed52abf7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75112025-03-25T01:25:32.227ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c947f50-2240-4ace-bf26-b967ed52abf7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75122025-03-25T01:25:32.243ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75132025-03-25T01:25:32.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75142025-03-25T01:25:32.245ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
75152025-03-25T01:25:32.245ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75162025-03-25T01:25:32.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75172025-03-25T01:25:32.257ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
75182025-03-25T01:25:32.258ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1fa07022-e7e4-408d-b329-062b13aa8043", "content-length": "134", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75192025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
75202025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
75212025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
75222025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
75232025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75242025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75252025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75262025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75272025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
75282025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
75292025-03-25T01:25:32.258ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
75302025-03-25T01:25:32.258ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75312025-03-25T01:25:32.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75322025-03-25T01:25:32.261ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
75332025-03-25T01:25:32.261ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "5099027e-836b-4a7e-9273-1394f2b22d98", "content-length": "2", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75342025-03-25T01:25:32.261ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
75352025-03-25T01:25:32.262ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "778059ef-1491-4262-851a-7463139a7505", "content-length": "51", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75362025-03-25T01:25:32.262ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
75372025-03-25T01:25:32.262ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
75382025-03-25T01:25:32.279ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
75392025-03-25T01:25:32.336ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
75402025-03-25T01:25:32.336ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
75412025-03-25T01:25:32.368ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
75422025-03-25T01:25:32.368ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:39952
75432025-03-25T01:25:32.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39952 req_id = 23943ecf-088a-44f9-9514-d9dbd6b46e1d roles = RoleSet { roles: {} } uri = /metrics/producers
75442025-03-25T01:25:32.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39952 req_id = 23943ecf-088a-44f9-9514-d9dbd6b46e1d resource = Database result = Ok(()) uri = /metrics/producers
75452025-03-25T01:25:32.369ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "b26f9ba6-0295-4969-a5b9-2525a2a469b2", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75462025-03-25T01:25:32.369ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
75472025-03-25T01:25:32.369ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
75482025-03-25T01:25:32.369ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2601fdc-8648-44ae-8460-b3e1733f4bec", "content-length": "682", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75492025-03-25T01:25:32.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75502025-03-25T01:25:32.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75512025-03-25T01:25:32.370ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "003623ec-3ff4-4ddc-993b-9be9b95dec5e", "content-length": "691", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75522025-03-25T01:25:32.370ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
75532025-03-25T01:25:32.370ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
75542025-03-25T01:25:32.370ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
75552025-03-25T01:25:32.372ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 636.195433ms iteration = 13 status = {}
75562025-03-25T01:25:32.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75572025-03-25T01:25:32.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75582025-03-25T01:25:32.378ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75592025-03-25T01:25:32.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75602025-03-25T01:25:32.380ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75612025-03-25T01:25:32.380ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75622025-03-25T01:25:32.388ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 651.866918ms iteration = 13 status = {}
75632025-03-25T01:25:32.419ZINFOnexus: assigned collector to new producer collector_id = a9f260fd-b911-4f87-b07b-84934591a3eb file = nexus/src/app/oximeter.rs:76 producer_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
75642025-03-25T01:25:32.419ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50932 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:39952 req_id = 23943ecf-088a-44f9-9514-d9dbd6b46e1d response_code = 201 uri = /metrics/producers
75652025-03-25T01:25:32.419ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "23943ecf-088a-44f9-9514-d9dbd6b46e1d", "content-length": "41", "date": "Tue, 25 Mar 2025 01:25:32 GMT"} })
75662025-03-25T01:25:32.421ZDEBGnexus (producer-registration-task): registered with nexus successfully
75672025-03-25T01:25:32.421ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
75682025-03-25T01:25:33.249ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a386d056-e016-4219-9482-390ea211fd09 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75692025-03-25T01:25:33.249ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a386d056-e016-4219-9482-390ea211fd09 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75702025-03-25T01:25:33.251ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2214 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a386d056-e016-4219-9482-390ea211fd09 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75712025-03-25T01:25:34.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7ab7ab78-e196-43ff-905b-fcfe5068c899 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75722025-03-25T01:25:34.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7ab7ab78-e196-43ff-905b-fcfe5068c899 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75732025-03-25T01:25:34.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1746 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7ab7ab78-e196-43ff-905b-fcfe5068c899 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75742025-03-25T01:25:35.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3e2a2b4-2cdb-463a-aa0a-5b9a991b2eb2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75752025-03-25T01:25:35.294ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3e2a2b4-2cdb-463a-aa0a-5b9a991b2eb2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75762025-03-25T01:25:35.296ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2043 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e3e2a2b4-2cdb-463a-aa0a-5b9a991b2eb2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75772025-03-25T01:25:35.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 948 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 585b8f8e-c30d-4aa8-976e-efa59f2d0b9f response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
75782025-03-25T01:25:36.316ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60abf030-d98f-4f9c-8c92-05c017322346 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75792025-03-25T01:25:36.316ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60abf030-d98f-4f9c-8c92-05c017322346 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75802025-03-25T01:25:36.318ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2200 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 60abf030-d98f-4f9c-8c92-05c017322346 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75812025-03-25T01:25:37.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 148a0ff6-2bd1-4adc-bf23-3ed5712d31eb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75822025-03-25T01:25:37.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 148a0ff6-2bd1-4adc-bf23-3ed5712d31eb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75832025-03-25T01:25:37.341ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1889 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 148a0ff6-2bd1-4adc-bf23-3ed5712d31eb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75842025-03-25T01:25:38.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 832ada3a-84e3-48e1-b492-cffe123d36db roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75852025-03-25T01:25:38.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 832ada3a-84e3-48e1-b492-cffe123d36db resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75862025-03-25T01:25:38.362ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 832ada3a-84e3-48e1-b492-cffe123d36db response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75872025-03-25T01:25:39.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 652a1bcd-5d2c-4da8-87e8-6e4013c50e46 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75882025-03-25T01:25:39.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 652a1bcd-5d2c-4da8-87e8-6e4013c50e46 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75892025-03-25T01:25:39.384ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1993 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 652a1bcd-5d2c-4da8-87e8-6e4013c50e46 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75902025-03-25T01:25:40.405ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 09275a6f-24c6-493c-8120-2d17ee88f49f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75912025-03-25T01:25:40.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 09275a6f-24c6-493c-8120-2d17ee88f49f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75922025-03-25T01:25:40.407ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1908 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 09275a6f-24c6-493c-8120-2d17ee88f49f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75932025-03-25T01:25:41.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = def8ff91-3c02-4a45-9602-75b803fda6b0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75942025-03-25T01:25:41.430ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = def8ff91-3c02-4a45-9602-75b803fda6b0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75952025-03-25T01:25:41.432ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2493 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = def8ff91-3c02-4a45-9602-75b803fda6b0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
75962025-03-25T01:25:41.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
75972025-03-25T01:25:41.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75982025-03-25T01:25:41.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75992025-03-25T01:25:41.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002025-03-25T01:25:41.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
76012025-03-25T01:25:41.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76022025-03-25T01:25:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76032025-03-25T01:25:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76042025-03-25T01:25:41.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76052025-03-25T01:25:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76062025-03-25T01:25:41.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76072025-03-25T01:25:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76082025-03-25T01:25:41.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76092025-03-25T01:25:41.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
76102025-03-25T01:25:41.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76112025-03-25T01:25:41.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76122025-03-25T01:25:41.754ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
76132025-03-25T01:25:41.754ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.283932ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
76142025-03-25T01:25:41.775ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76152025-03-25T01:25:41.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76162025-03-25T01:25:41.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.950081ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76172025-03-25T01:25:42.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dfb9c4a9-2d37-4efa-acf5-113d157f2905 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76182025-03-25T01:25:42.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dfb9c4a9-2d37-4efa-acf5-113d157f2905 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76192025-03-25T01:25:42.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2360 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dfb9c4a9-2d37-4efa-acf5-113d157f2905 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76202025-03-25T01:25:43.476ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f32364b0-6275-48fa-9366-53022942d2e9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76212025-03-25T01:25:43.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f32364b0-6275-48fa-9366-53022942d2e9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76222025-03-25T01:25:43.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2188 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f32364b0-6275-48fa-9366-53022942d2e9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76232025-03-25T01:25:44.498ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41de37bf-e15d-45c8-98ab-b0d7654dc69e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76242025-03-25T01:25:44.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41de37bf-e15d-45c8-98ab-b0d7654dc69e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76252025-03-25T01:25:44.500ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 41de37bf-e15d-45c8-98ab-b0d7654dc69e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76262025-03-25T01:25:45.519ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c2665a2-3faf-4828-b746-402108bea66f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76272025-03-25T01:25:45.519ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c2665a2-3faf-4828-b746-402108bea66f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76282025-03-25T01:25:45.521ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2348 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c2665a2-3faf-4828-b746-402108bea66f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76292025-03-25T01:25:45.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 7ea0a225-cb69-458e-b7ec-3caa306302c4 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
76302025-03-25T01:25:45.756ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 7ea0a225-cb69-458e-b7ec-3caa306302c4 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
76312025-03-25T01:25:45.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3482 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 7ea0a225-cb69-458e-b7ec-3caa306302c4 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
76322025-03-25T01:25:45.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 8e7ece3f-6b6d-4d45-9800-3cd9071893dd roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
76332025-03-25T01:25:45.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 8e7ece3f-6b6d-4d45-9800-3cd9071893dd resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
76342025-03-25T01:25:45.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2098 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 8e7ece3f-6b6d-4d45-9800-3cd9071893dd response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
76352025-03-25T01:25:45.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 420 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = d5b9a299-9c70-49ce-ae3e-c6cf06d541db response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
76362025-03-25T01:25:46.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1252e454-c9eb-41ba-9154-2ef3343d7f8b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76372025-03-25T01:25:46.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1252e454-c9eb-41ba-9154-2ef3343d7f8b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76382025-03-25T01:25:46.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1252e454-c9eb-41ba-9154-2ef3343d7f8b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76392025-03-25T01:25:47.564ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ffff94a-a348-4aa6-8479-decafac2e132 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76402025-03-25T01:25:47.564ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ffff94a-a348-4aa6-8479-decafac2e132 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76412025-03-25T01:25:47.567ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2663 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ffff94a-a348-4aa6-8479-decafac2e132 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76422025-03-25T01:25:48.588ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7426172a-e2a6-42fa-b67d-7a43a5246760 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76432025-03-25T01:25:48.588ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7426172a-e2a6-42fa-b67d-7a43a5246760 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76442025-03-25T01:25:48.589ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1779 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7426172a-e2a6-42fa-b67d-7a43a5246760 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76452025-03-25T01:25:49.609ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2bb2f2b5-5bc3-4a92-9a75-03256743f485 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76462025-03-25T01:25:49.610ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2bb2f2b5-5bc3-4a92-9a75-03256743f485 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76472025-03-25T01:25:49.612ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2185 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2bb2f2b5-5bc3-4a92-9a75-03256743f485 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76482025-03-25T01:25:50.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87750b93-f33f-4730-b68c-b4752b3b1396 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76492025-03-25T01:25:50.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87750b93-f33f-4730-b68c-b4752b3b1396 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76502025-03-25T01:25:50.635ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1924 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87750b93-f33f-4730-b68c-b4752b3b1396 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76512025-03-25T01:25:51.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6da309ed-9c22-419d-b1ac-2d1ad36013e9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76522025-03-25T01:25:51.655ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6da309ed-9c22-419d-b1ac-2d1ad36013e9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76532025-03-25T01:25:51.657ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6da309ed-9c22-419d-b1ac-2d1ad36013e9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76542025-03-25T01:25:51.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
76552025-03-25T01:25:51.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76562025-03-25T01:25:51.736ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76572025-03-25T01:25:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76582025-03-25T01:25:51.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
76592025-03-25T01:25:51.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76602025-03-25T01:25:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76612025-03-25T01:25:51.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
76622025-03-25T01:25:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
76632025-03-25T01:25:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
76642025-03-25T01:25:51.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76652025-03-25T01:25:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76662025-03-25T01:25:51.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 2.978412ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
76672025-03-25T01:25:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76682025-03-25T01:25:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76692025-03-25T01:25:51.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76702025-03-25T01:25:51.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
76712025-03-25T01:25:51.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
76722025-03-25T01:25:51.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
76732025-03-25T01:25:51.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
76742025-03-25T01:25:51.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.490099ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
76752025-03-25T01:25:52.677ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a64915a-8de4-4c76-9547-31b5489999a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76762025-03-25T01:25:52.678ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a64915a-8de4-4c76-9547-31b5489999a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76772025-03-25T01:25:52.679ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a64915a-8de4-4c76-9547-31b5489999a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76782025-03-25T01:25:53.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afb0ee3b-b92d-43ae-b090-0309edc71b29 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76792025-03-25T01:25:53.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afb0ee3b-b92d-43ae-b090-0309edc71b29 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76802025-03-25T01:25:53.702ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afb0ee3b-b92d-43ae-b090-0309edc71b29 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76812025-03-25T01:25:54.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 004cf4ab-6f32-452c-a1ba-7455460ca69e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76822025-03-25T01:25:54.723ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 004cf4ab-6f32-452c-a1ba-7455460ca69e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76832025-03-25T01:25:54.724ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1934 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 004cf4ab-6f32-452c-a1ba-7455460ca69e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76842025-03-25T01:25:55.745ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c6fc157-19f0-4a9f-aa88-fa910f533f45 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76852025-03-25T01:25:55.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c6fc157-19f0-4a9f-aa88-fa910f533f45 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76862025-03-25T01:25:55.747ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c6fc157-19f0-4a9f-aa88-fa910f533f45 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76872025-03-25T01:25:55.763ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 491 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 91feff79-20c2-42f9-bd4a-d2daa5a8a5ee response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
76882025-03-25T01:25:56.769ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = acade106-c8f2-460f-bdfd-b14814132bf4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76892025-03-25T01:25:56.769ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = acade106-c8f2-460f-bdfd-b14814132bf4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76902025-03-25T01:25:56.771ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2941 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = acade106-c8f2-460f-bdfd-b14814132bf4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76912025-03-25T01:25:57.792ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c7ba562-5f22-4dd3-b982-3c9e375f1d28 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76922025-03-25T01:25:57.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c7ba562-5f22-4dd3-b982-3c9e375f1d28 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76932025-03-25T01:25:57.794ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1963 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0c7ba562-5f22-4dd3-b982-3c9e375f1d28 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76942025-03-25T01:25:58.815ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38b60ffb-b691-401a-80c4-a82941866289 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76952025-03-25T01:25:58.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38b60ffb-b691-401a-80c4-a82941866289 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76962025-03-25T01:25:58.817ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2576 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38b60ffb-b691-401a-80c4-a82941866289 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76972025-03-25T01:25:59.837ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 589e1866-dedb-496f-8c4c-2765f9305c28 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76982025-03-25T01:25:59.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 589e1866-dedb-496f-8c4c-2765f9305c28 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
76992025-03-25T01:25:59.839ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2319 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 589e1866-dedb-496f-8c4c-2765f9305c28 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
77002025-03-25T01:26:00.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 18150271-ac05-497e-acdf-74aef9de4356 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
77012025-03-25T01:26:00.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 18150271-ac05-497e-acdf-74aef9de4356 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
77022025-03-25T01:26:00.759ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3072 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = 18150271-ac05-497e-acdf-74aef9de4356 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
77032025-03-25T01:26:00.760ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = ad65594f-23a0-46c0-be64-f39c1fc233ba roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
77042025-03-25T01:26:00.760ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = ad65594f-23a0-46c0-be64-f39c1fc233ba resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
77052025-03-25T01:26:00.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2053 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:54329 req_id = ad65594f-23a0-46c0-be64-f39c1fc233ba response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
77062025-03-25T01:26:00.861ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 232f7e9a-e67d-4651-b83a-d49626da85e5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
77072025-03-25T01:26:00.862ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 232f7e9a-e67d-4651-b83a-d49626da85e5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
77082025-03-25T01:26:00.863ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1926 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 232f7e9a-e67d-4651-b83a-d49626da85e5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
77092025-03-25T01:26:01.736ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
77102025-03-25T01:26:01.736ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
77112025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
77122025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77132025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77142025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
77152025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77162025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77172025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 14 reason = Timeout
77182025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77192025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
77202025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77212025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
77222025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
77232025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77242025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
77252025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77262025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
77272025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77282025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77292025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77302025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77312025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77322025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77332025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77342025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77352025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77362025-03-25T01:26:01.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77372025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
77382025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
77392025-03-25T01:26:01.738ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77402025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77412025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77422025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 14 reason = Timeout
77432025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
77442025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
77452025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
77462025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
77472025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77482025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
77492025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77502025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
77512025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
77522025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77532025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
77542025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
77552025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77562025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77572025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77582025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
77592025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
77602025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
77612025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77622025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77632025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
77642025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77652025-03-25T01:26:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
77662025-03-25T01:26:01.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77672025-03-25T01:26:01.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77682025-03-25T01:26:01.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77692025-03-25T01:26:01.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77702025-03-25T01:26:01.740ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.772184ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
77712025-03-25T01:26:01.740ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77722025-03-25T01:26:01.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
77732025-03-25T01:26:01.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77742025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77752025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77762025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77772025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77782025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
77792025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77802025-03-25T01:26:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77812025-03-25T01:26:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
77822025-03-25T01:26:01.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
77832025-03-25T01:26:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
77842025-03-25T01:26:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
77852025-03-25T01:26:01.744ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77862025-03-25T01:26:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77872025-03-25T01:26:01.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 459366141 } })
77882025-03-25T01:26:01.745ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
77892025-03-25T01:26:01.747ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77902025-03-25T01:26:01.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 461061845 } })
77912025-03-25T01:26:01.747ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
77922025-03-25T01:26:01.748ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77932025-03-25T01:26:01.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
77942025-03-25T01:26:01.750ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77952025-03-25T01:26:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77962025-03-25T01:26:01.751ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
77972025-03-25T01:26:01.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77982025-03-25T01:26:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77992025-03-25T01:26:01.758ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78002025-03-25T01:26:01.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78012025-03-25T01:26:01.760ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 22.155357ms iteration = 14 status = {"errors":[],"requests_created_ok":[]}
78022025-03-25T01:26:01.764ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1265, tv_nsec: 477982217 } })
78032025-03-25T01:26:01.764ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
78042025-03-25T01:26:01.765ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78052025-03-25T01:26:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78062025-03-25T01:26:01.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78072025-03-25T01:26:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78082025-03-25T01:26:01.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78092025-03-25T01:26:01.771ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78102025-03-25T01:26:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
78112025-03-25T01:26:01.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78122025-03-25T01:26:01.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78132025-03-25T01:26:01.775ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78142025-03-25T01:26:01.775ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78152025-03-25T01:26:01.775ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78162025-03-25T01:26:01.788ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
78172025-03-25T01:26:01.788ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.197573ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
78182025-03-25T01:26:01.803ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78192025-03-25T01:26:01.803ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78202025-03-25T01:26:01.803ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78212025-03-25T01:26:01.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78222025-03-25T01:26:01.814ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78232025-03-25T01:26:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78242025-03-25T01:26:01.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78252025-03-25T01:26:01.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78262025-03-25T01:26:01.816ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.323731ms iteration = 14 status = {"errors":[],"finish_invoked_ok":[]}
78272025-03-25T01:26:01.816ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78282025-03-25T01:26:01.817ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78292025-03-25T01:26:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 79.083361ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78302025-03-25T01:26:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 79.759481ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
78312025-03-25T01:26:01.818ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78322025-03-25T01:26:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78332025-03-25T01:26:01.820ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78342025-03-25T01:26:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78352025-03-25T01:26:01.825ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78362025-03-25T01:26:01.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78372025-03-25T01:26:01.825ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78382025-03-25T01:26:01.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78392025-03-25T01:26:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78402025-03-25T01:26:01.827ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78412025-03-25T01:26:01.827ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 89.330788ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78422025-03-25T01:26:01.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78432025-03-25T01:26:01.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78442025-03-25T01:26:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78452025-03-25T01:26:01.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78462025-03-25T01:26:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78472025-03-25T01:26:01.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78482025-03-25T01:26:01.834ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
78492025-03-25T01:26:01.834ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78502025-03-25T01:26:01.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78512025-03-25T01:26:01.838ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.106057ms iteration = 14 status = 0
78522025-03-25T01:26:01.844ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
78532025-03-25T01:26:01.844ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78542025-03-25T01:26:01.844ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c866869f-6e20-4411-bdd5-7b5b03cba657", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
78552025-03-25T01:26:01.844ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78562025-03-25T01:26:01.846ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78572025-03-25T01:26:01.848ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 111.148871ms iteration = 16 status = {"physical_disks_added":0}
78582025-03-25T01:26:01.849ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78592025-03-25T01:26:01.849ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78602025-03-25T01:26:01.849ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78612025-03-25T01:26:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78622025-03-25T01:26:01.850ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 113.297642ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78632025-03-25T01:26:01.854ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
78642025-03-25T01:26:01.854ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78652025-03-25T01:26:01.855ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3296d86-3bbd-499d-ac65-0fc581705b0e", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
78662025-03-25T01:26:01.855ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78672025-03-25T01:26:01.856ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
78682025-03-25T01:26:01.857ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 119.603162ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
78692025-03-25T01:26:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 122.333811ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78702025-03-25T01:26:01.862ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78712025-03-25T01:26:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
78722025-03-25T01:26:01.864ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
78732025-03-25T01:26:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
78742025-03-25T01:26:01.866ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
78752025-03-25T01:26:01.866ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 129.169828ms iteration = 14 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
78762025-03-25T01:26:01.881ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78772025-03-25T01:26:01.881ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78782025-03-25T01:26:01.881ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 143.355421ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78792025-03-25T01:26:01.883ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
78802025-03-25T01:26:01.883ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
78812025-03-25T01:26:01.884ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4898e499-cbce-4602-a4a2-9ebfd7028673", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
78822025-03-25T01:26:01.884ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
78832025-03-25T01:26:01.884ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1bdda097-f627-4565-a6f4-06b2eed20502 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
78842025-03-25T01:26:01.884ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1bdda097-f627-4565-a6f4-06b2eed20502 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
78852025-03-25T01:26:01.885ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
78862025-03-25T01:26:01.886ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2183 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1bdda097-f627-4565-a6f4-06b2eed20502 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
78872025-03-25T01:26:01.901ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78882025-03-25T01:26:01.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78892025-03-25T01:26:01.911ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78902025-03-25T01:26:01.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78912025-03-25T01:26:01.961ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 224.046686ms iteration = 14 status = {}
78922025-03-25T01:26:01.965ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
78932025-03-25T01:26:01.966ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e40c9b27-9e00-48f8-bbfe-d37c8bc83680", "content-length": "1", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
78942025-03-25T01:26:01.967ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
78952025-03-25T01:26:01.967ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
78962025-03-25T01:26:01.989ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
78972025-03-25T01:26:01.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
78982025-03-25T01:26:01.990ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dd84dd5-53ef-41f5-9d70-2b3e5737a3b0", "content-length": "372", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
78992025-03-25T01:26:01.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79002025-03-25T01:26:01.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79012025-03-25T01:26:01.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79022025-03-25T01:26:01.992ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 255.127371ms iteration = 14 status = null
79032025-03-25T01:26:01.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79042025-03-25T01:26:01.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79052025-03-25T01:26:01.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79062025-03-25T01:26:01.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79072025-03-25T01:26:01.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79082025-03-25T01:26:01.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79092025-03-25T01:26:01.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79102025-03-25T01:26:02.004ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
79112025-03-25T01:26:02.004ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79122025-03-25T01:26:02.004ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "157c6082-2241-46d0-a48a-d4711e4e18cd", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79132025-03-25T01:26:02.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79142025-03-25T01:26:02.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79152025-03-25T01:26:02.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79162025-03-25T01:26:02.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79172025-03-25T01:26:02.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79182025-03-25T01:26:02.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79192025-03-25T01:26:02.014ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79202025-03-25T01:26:02.014ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79212025-03-25T01:26:02.014ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e1fccc13-01b2-4769-8ba9-2a2961f34848", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79222025-03-25T01:26:02.016ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 278.301022ms iteration = 14 status = {}
79232025-03-25T01:26:02.052ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79242025-03-25T01:26:02.052ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6685d11-3c43-4bb5-a519-f42f168eb031", "content-length": "691", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79252025-03-25T01:26:02.052ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
79262025-03-25T01:26:02.053ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
79272025-03-25T01:26:02.053ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
79282025-03-25T01:26:02.054ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 317.552404ms iteration = 14 status = {}
79292025-03-25T01:26:02.071ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79302025-03-25T01:26:02.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79312025-03-25T01:26:02.073ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
79322025-03-25T01:26:02.073ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79332025-03-25T01:26:02.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79342025-03-25T01:26:02.081ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79352025-03-25T01:26:02.082ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "115e59e2-1203-4a25-bd7e-280dcb430701", "content-length": "134", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79362025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79372025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
79382025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79392025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79402025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79412025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79422025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79432025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79442025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79452025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79462025-03-25T01:26:02.082ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
79472025-03-25T01:26:02.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79482025-03-25T01:26:02.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79492025-03-25T01:26:02.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79502025-03-25T01:26:02.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6753a1b-a9d1-4ddb-a945-abc25753b606", "content-length": "2", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79512025-03-25T01:26:02.085ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79522025-03-25T01:26:02.085ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "44470189-46e5-429a-9257-8fa01c4b9e4a", "content-length": "51", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79532025-03-25T01:26:02.085ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
79542025-03-25T01:26:02.085ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79552025-03-25T01:26:02.183ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "2f90a564-9d43-4cd9-9ace-b3c41ca44827", "date": "Tue, 25 Mar 2025 01:26:01 GMT"} })
79562025-03-25T01:26:02.183ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
79572025-03-25T01:26:02.183ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79582025-03-25T01:26:02.184ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "42f081c0-6885-453a-95fa-84219bad219d", "content-length": "682", "date": "Tue, 25 Mar 2025 01:26:02 GMT"} })
79592025-03-25T01:26:02.184ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79602025-03-25T01:26:02.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79612025-03-25T01:26:02.187ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79622025-03-25T01:26:02.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79632025-03-25T01:26:02.191ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79642025-03-25T01:26:02.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79652025-03-25T01:26:02.193ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79662025-03-25T01:26:02.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79672025-03-25T01:26:02.200ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 463.123067ms iteration = 14 status = {}
79682025-03-25T01:26:02.909ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a107e85-8cbb-4861-837a-f38294cc4e53 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79692025-03-25T01:26:02.909ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a107e85-8cbb-4861-837a-f38294cc4e53 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79702025-03-25T01:26:02.911ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6a107e85-8cbb-4861-837a-f38294cc4e53 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79712025-03-25T01:26:03.932ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0dee90b4-64d5-4592-9c0d-ea3da4bb7d8b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79722025-03-25T01:26:03.932ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0dee90b4-64d5-4592-9c0d-ea3da4bb7d8b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79732025-03-25T01:26:03.933ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1686 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0dee90b4-64d5-4592-9c0d-ea3da4bb7d8b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79742025-03-25T01:26:04.955ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c230745-9851-4d91-878e-b5fcaa88d791 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79752025-03-25T01:26:04.955ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c230745-9851-4d91-878e-b5fcaa88d791 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79762025-03-25T01:26:04.957ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2460 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c230745-9851-4d91-878e-b5fcaa88d791 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79772025-03-25T01:26:05.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 734 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 59102f24-3064-4c45-b5fc-c0fe32b903fe response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
79782025-03-25T01:26:05.979ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46001240-69d8-4707-ad8d-7fbd558a8fa7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79792025-03-25T01:26:05.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46001240-69d8-4707-ad8d-7fbd558a8fa7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79802025-03-25T01:26:05.981ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46001240-69d8-4707-ad8d-7fbd558a8fa7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79812025-03-25T01:26:07.001ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 08c41080-c647-42d9-ae03-4bdce02bfa19 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79822025-03-25T01:26:07.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 08c41080-c647-42d9-ae03-4bdce02bfa19 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79832025-03-25T01:26:07.004ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2527 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 08c41080-c647-42d9-ae03-4bdce02bfa19 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79842025-03-25T01:26:08.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b4d4f26-ff4e-4408-8914-819d3f0e0b73 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79852025-03-25T01:26:08.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b4d4f26-ff4e-4408-8914-819d3f0e0b73 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79862025-03-25T01:26:08.026ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2167 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7b4d4f26-ff4e-4408-8914-819d3f0e0b73 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79872025-03-25T01:26:09.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 26ec9ad2-0901-4884-9a37-3b38a7cc5d53 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79882025-03-25T01:26:09.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 26ec9ad2-0901-4884-9a37-3b38a7cc5d53 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79892025-03-25T01:26:09.048ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1854 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 26ec9ad2-0901-4884-9a37-3b38a7cc5d53 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79902025-03-25T01:26:10.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ec1b7d5-bac2-4d97-bee2-04f6054d258c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79912025-03-25T01:26:10.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ec1b7d5-bac2-4d97-bee2-04f6054d258c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79922025-03-25T01:26:10.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2220 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4ec1b7d5-bac2-4d97-bee2-04f6054d258c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79932025-03-25T01:26:11.092ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec56ede6-d8f1-4fa1-b72a-cd95468dfd07 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79942025-03-25T01:26:11.092ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec56ede6-d8f1-4fa1-b72a-cd95468dfd07 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79952025-03-25T01:26:11.094ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2244 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec56ede6-d8f1-4fa1-b72a-cd95468dfd07 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
79962025-03-25T01:26:11.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
79972025-03-25T01:26:11.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79982025-03-25T01:26:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79992025-03-25T01:26:11.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
80002025-03-25T01:26:11.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80012025-03-25T01:26:11.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80022025-03-25T01:26:11.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80032025-03-25T01:26:11.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80042025-03-25T01:26:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80052025-03-25T01:26:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80062025-03-25T01:26:11.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80072025-03-25T01:26:11.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80082025-03-25T01:26:11.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.890205ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80092025-03-25T01:26:11.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80102025-03-25T01:26:11.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80112025-03-25T01:26:11.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80122025-03-25T01:26:11.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
80132025-03-25T01:26:11.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80142025-03-25T01:26:11.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80152025-03-25T01:26:11.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
80162025-03-25T01:26:11.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.947811ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
80172025-03-25T01:26:12.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a9af603-3916-4a24-a5d8-e7f901370d78 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80182025-03-25T01:26:12.113ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a9af603-3916-4a24-a5d8-e7f901370d78 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80192025-03-25T01:26:12.115ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2204 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4a9af603-3916-4a24-a5d8-e7f901370d78 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80202025-03-25T01:26:13.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 494f7662-bc98-49c7-a39a-e5aed00a1ee8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80212025-03-25T01:26:13.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 494f7662-bc98-49c7-a39a-e5aed00a1ee8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80222025-03-25T01:26:13.137ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1784 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 494f7662-bc98-49c7-a39a-e5aed00a1ee8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80232025-03-25T01:26:14.159ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d25c6be3-854b-4747-9b34-ba9211c443e9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80242025-03-25T01:26:14.159ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d25c6be3-854b-4747-9b34-ba9211c443e9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80252025-03-25T01:26:14.161ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d25c6be3-854b-4747-9b34-ba9211c443e9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80262025-03-25T01:26:15.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b840f564-3e12-40cf-a814-56af4f64be15 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80272025-03-25T01:26:15.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b840f564-3e12-40cf-a814-56af4f64be15 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80282025-03-25T01:26:15.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2469 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b840f564-3e12-40cf-a814-56af4f64be15 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80292025-03-25T01:26:15.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 425 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 882e98d1-ea44-44c3-b67e-2421c1218bdd response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
80302025-03-25T01:26:16.206ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c64c460d-bbf2-44df-a9f4-7a6cc83681fc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80312025-03-25T01:26:16.206ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c64c460d-bbf2-44df-a9f4-7a6cc83681fc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80322025-03-25T01:26:16.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2407 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c64c460d-bbf2-44df-a9f4-7a6cc83681fc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80332025-03-25T01:26:17.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 97c2ae08-e44e-47f1-9fe8-d28e0f6e9826 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80342025-03-25T01:26:17.229ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 97c2ae08-e44e-47f1-9fe8-d28e0f6e9826 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80352025-03-25T01:26:17.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2426 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 97c2ae08-e44e-47f1-9fe8-d28e0f6e9826 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80362025-03-25T01:26:18.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 024f6501-1399-4f03-8801-62a7c5c3d239 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80372025-03-25T01:26:18.252ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 024f6501-1399-4f03-8801-62a7c5c3d239 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80382025-03-25T01:26:18.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1919 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 024f6501-1399-4f03-8801-62a7c5c3d239 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80392025-03-25T01:26:19.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 551950f6-7876-4229-bf57-258448b06292 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80402025-03-25T01:26:19.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 551950f6-7876-4229-bf57-258448b06292 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80412025-03-25T01:26:19.276ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 551950f6-7876-4229-bf57-258448b06292 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80422025-03-25T01:26:20.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bec24ad1-c853-4bf7-ae51-983163d0243d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80432025-03-25T01:26:20.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bec24ad1-c853-4bf7-ae51-983163d0243d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80442025-03-25T01:26:20.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2505 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = bec24ad1-c853-4bf7-ae51-983163d0243d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80452025-03-25T01:26:21.318ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a42ac33a-2635-41e9-bf0c-8017be841570 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80462025-03-25T01:26:21.319ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a42ac33a-2635-41e9-bf0c-8017be841570 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80472025-03-25T01:26:21.320ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1793 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a42ac33a-2635-41e9-bf0c-8017be841570 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80482025-03-25T01:26:21.736ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
80492025-03-25T01:26:21.736ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80502025-03-25T01:26:21.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80512025-03-25T01:26:21.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
80522025-03-25T01:26:21.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80532025-03-25T01:26:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80542025-03-25T01:26:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80552025-03-25T01:26:21.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80562025-03-25T01:26:21.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80572025-03-25T01:26:21.741ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.538091ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80582025-03-25T01:26:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80592025-03-25T01:26:21.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80602025-03-25T01:26:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80612025-03-25T01:26:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80622025-03-25T01:26:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80632025-03-25T01:26:21.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80642025-03-25T01:26:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
80652025-03-25T01:26:21.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80662025-03-25T01:26:21.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80672025-03-25T01:26:21.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
80682025-03-25T01:26:21.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.968634ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
80692025-03-25T01:26:22.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1ed9af30-f180-4378-91b2-e3e4e3961664 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80702025-03-25T01:26:22.341ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1ed9af30-f180-4378-91b2-e3e4e3961664 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80712025-03-25T01:26:22.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1479 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1ed9af30-f180-4378-91b2-e3e4e3961664 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80722025-03-25T01:26:23.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cf9c2d19-93b3-4e80-99fc-a6c89744b557 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80732025-03-25T01:26:23.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cf9c2d19-93b3-4e80-99fc-a6c89744b557 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80742025-03-25T01:26:23.366ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2442 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = cf9c2d19-93b3-4e80-99fc-a6c89744b557 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80752025-03-25T01:26:24.387ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06a57cb2-b431-445e-baf4-514b68041815 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80762025-03-25T01:26:24.388ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06a57cb2-b431-445e-baf4-514b68041815 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80772025-03-25T01:26:24.390ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2762 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06a57cb2-b431-445e-baf4-514b68041815 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80782025-03-25T01:26:25.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2261c5ff-0800-4578-84c7-cb9d6e37ef34 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80792025-03-25T01:26:25.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2261c5ff-0800-4578-84c7-cb9d6e37ef34 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80802025-03-25T01:26:25.412ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1955 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2261c5ff-0800-4578-84c7-cb9d6e37ef34 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80812025-03-25T01:26:25.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 403 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = fb983d21-e22f-45c8-8fc7-83cfd19adc84 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
80822025-03-25T01:26:26.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2c410af-f5e4-423f-b3fc-f12cbe81bbde roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80832025-03-25T01:26:26.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2c410af-f5e4-423f-b3fc-f12cbe81bbde resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80842025-03-25T01:26:26.435ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2087 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2c410af-f5e4-423f-b3fc-f12cbe81bbde response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80852025-03-25T01:26:27.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54d40549-0a73-4919-a4b4-bd06db1c587f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80862025-03-25T01:26:27.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54d40549-0a73-4919-a4b4-bd06db1c587f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80872025-03-25T01:26:27.457ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1847 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54d40549-0a73-4919-a4b4-bd06db1c587f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80882025-03-25T01:26:28.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6016e9b7-e5b6-4307-963a-bb98d2aa9016 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80892025-03-25T01:26:28.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6016e9b7-e5b6-4307-963a-bb98d2aa9016 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80902025-03-25T01:26:28.480ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2366 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6016e9b7-e5b6-4307-963a-bb98d2aa9016 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80912025-03-25T01:26:29.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bab5f82-56dd-416a-9f34-68ba552c2532 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80922025-03-25T01:26:29.500ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bab5f82-56dd-416a-9f34-68ba552c2532 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80932025-03-25T01:26:29.501ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8bab5f82-56dd-416a-9f34-68ba552c2532 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80942025-03-25T01:26:30.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d7d3383-cd01-4ad4-bc14-bcc1e4721f1f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80952025-03-25T01:26:30.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d7d3383-cd01-4ad4-bc14-bcc1e4721f1f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80962025-03-25T01:26:30.524ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2093 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9d7d3383-cd01-4ad4-bc14-bcc1e4721f1f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80972025-03-25T01:26:31.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b40104-433e-4335-9830-d6b01174d7fa roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80982025-03-25T01:26:31.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b40104-433e-4335-9830-d6b01174d7fa resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
80992025-03-25T01:26:31.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2065 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b40104-433e-4335-9830-d6b01174d7fa response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
81002025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
81012025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
81022025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81032025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
81042025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81052025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
81062025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 15 reason = Timeout
81072025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
81082025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
81092025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81102025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
81112025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81122025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
81132025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
81142025-03-25T01:26:31.737ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
81152025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
81162025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.83\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
81172025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
81182025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
81192025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
81202025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
81212025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81222025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81232025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
81242025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
81252025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81262025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
81272025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81282025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
81292025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81302025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
81312025-03-25T01:26:31.737ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
81322025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81332025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
81342025-03-25T01:26:31.737ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:16:31.737309213 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
81352025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
81362025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
81372025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81382025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
81392025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
81402025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81412025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81422025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81432025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
81442025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81452025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81462025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81472025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81482025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81492025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81502025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
81512025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
81522025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
81532025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
81542025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81552025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
81562025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81572025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81582025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
81592025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 15 reason = Timeout
81602025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81612025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
81622025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
81632025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
81642025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
81652025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81662025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81672025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
81682025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
81692025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81702025-03-25T01:26:31.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81712025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
81722025-03-25T01:26:31.738ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81732025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81742025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
81752025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
81762025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
81772025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81782025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81792025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81802025-03-25T01:26:31.738ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 451309605 } })
81812025-03-25T01:26:31.738ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 451343146 } })
81822025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
81832025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81842025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81852025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81862025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81872025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81882025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81892025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81902025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81912025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81922025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81932025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
81942025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.142606ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
81952025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
81962025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.601513ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
81972025-03-25T01:26:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81982025-03-25T01:26:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81992025-03-25T01:26:31.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82002025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82012025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.040838ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82022025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82032025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
82042025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82052025-03-25T01:26:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82062025-03-25T01:26:31.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 457564135 } })
82072025-03-25T01:26:31.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 457727287 } })
82082025-03-25T01:26:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
82092025-03-25T01:26:31.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
82102025-03-25T01:26:31.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
82112025-03-25T01:26:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
82122025-03-25T01:26:31.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
82132025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82142025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82152025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82162025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82172025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82182025-03-25T01:26:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82192025-03-25T01:26:31.746ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82202025-03-25T01:26:31.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82212025-03-25T01:26:31.747ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82222025-03-25T01:26:31.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82232025-03-25T01:26:31.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82242025-03-25T01:26:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82252025-03-25T01:26:31.750ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82262025-03-25T01:26:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82272025-03-25T01:26:31.751ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82282025-03-25T01:26:31.751ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82292025-03-25T01:26:31.753ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:16:31.737309213 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
82302025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.926678ms iteration = 8 status = {"expiration":"2025-03-25T01:16:31.737309213Z","pruned":[]}
82312025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
82322025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82332025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
82342025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82352025-03-25T01:26:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82362025-03-25T01:26:31.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82372025-03-25T01:26:31.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82382025-03-25T01:26:31.757ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82392025-03-25T01:26:31.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82402025-03-25T01:26:31.758ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.30655ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
82412025-03-25T01:26:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82422025-03-25T01:26:31.761ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82432025-03-25T01:26:31.764ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82442025-03-25T01:26:31.764ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82452025-03-25T01:26:31.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82462025-03-25T01:26:31.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 31.591742ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
82472025-03-25T01:26:31.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82482025-03-25T01:26:31.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82492025-03-25T01:26:31.781ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82502025-03-25T01:26:31.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82512025-03-25T01:26:31.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1295, tv_nsec: 496172817 } })
82522025-03-25T01:26:31.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82532025-03-25T01:26:31.783ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
82542025-03-25T01:26:31.783ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82552025-03-25T01:26:31.785ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82562025-03-25T01:26:31.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82572025-03-25T01:26:31.786ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82582025-03-25T01:26:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82592025-03-25T01:26:31.788ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82602025-03-25T01:26:31.789ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82612025-03-25T01:26:31.789ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82622025-03-25T01:26:31.790ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82632025-03-25T01:26:31.792ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82642025-03-25T01:26:31.792ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82652025-03-25T01:26:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82662025-03-25T01:26:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
82672025-03-25T01:26:31.795ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82682025-03-25T01:26:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82692025-03-25T01:26:31.795ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82702025-03-25T01:26:31.797ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
82712025-03-25T01:26:31.797ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.530032ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
82722025-03-25T01:26:31.798ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82732025-03-25T01:26:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82742025-03-25T01:26:31.799ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82752025-03-25T01:26:31.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82762025-03-25T01:26:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82772025-03-25T01:26:31.803ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82782025-03-25T01:26:31.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82792025-03-25T01:26:31.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82802025-03-25T01:26:31.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82812025-03-25T01:26:31.832ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
82822025-03-25T01:26:31.832ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 94.863947ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
82832025-03-25T01:26:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82842025-03-25T01:26:31.840ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 102.597768ms iteration = 15 status = {"errors":[],"requests_created_ok":[]}
82852025-03-25T01:26:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82862025-03-25T01:26:31.847ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82872025-03-25T01:26:31.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82882025-03-25T01:26:31.853ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82892025-03-25T01:26:31.853ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82902025-03-25T01:26:31.853ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 115.593974ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82912025-03-25T01:26:31.853ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82922025-03-25T01:26:31.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82932025-03-25T01:26:31.855ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82942025-03-25T01:26:31.856ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82952025-03-25T01:26:31.856ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
82962025-03-25T01:26:31.856ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
82972025-03-25T01:26:31.856ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
82982025-03-25T01:26:31.856ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82992025-03-25T01:26:31.857ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83002025-03-25T01:26:31.858ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 120.335652ms iteration = 15 status = {"errors":[],"finish_invoked_ok":[]}
83012025-03-25T01:26:31.859ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83022025-03-25T01:26:31.859ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
83032025-03-25T01:26:31.859ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83042025-03-25T01:26:31.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83052025-03-25T01:26:31.861ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
83062025-03-25T01:26:31.861ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
83072025-03-25T01:26:31.861ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 123.73715ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
83082025-03-25T01:26:31.861ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83092025-03-25T01:26:31.862ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83102025-03-25T01:26:31.865ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
83112025-03-25T01:26:31.865ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
83122025-03-25T01:26:31.865ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
83132025-03-25T01:26:31.865ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83142025-03-25T01:26:31.865ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83152025-03-25T01:26:31.878ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
83162025-03-25T01:26:31.901ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
83172025-03-25T01:26:31.901ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
83182025-03-25T01:26:31.907ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
83192025-03-25T01:26:31.907ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83202025-03-25T01:26:31.907ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "57881c4e-6595-4770-8589-a97e6da4489a", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83212025-03-25T01:26:31.907ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83222025-03-25T01:26:31.910ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83232025-03-25T01:26:31.943ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
83242025-03-25T01:26:31.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83252025-03-25T01:26:31.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83262025-03-25T01:26:31.950ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 213.333452ms iteration = 17 status = {"physical_disks_added":0}
83272025-03-25T01:26:31.954ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
83282025-03-25T01:26:31.954ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83292025-03-25T01:26:31.954ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c702d9bc-2a13-4a10-b3ac-a828c0e1fc48", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83302025-03-25T01:26:31.954ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83312025-03-25T01:26:31.956ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83322025-03-25T01:26:31.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
83332025-03-25T01:26:31.962ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83342025-03-25T01:26:31.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef20ff3c-3dcc-4c06-b785-872427d4c2db", "content-length": "26", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83352025-03-25T01:26:31.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83362025-03-25T01:26:31.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
83372025-03-25T01:26:31.984ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
83382025-03-25T01:26:31.984ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83392025-03-25T01:26:31.985ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "55659e43-23b3-43de-bd44-db438a06fcf7", "content-length": "372", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83402025-03-25T01:26:31.985ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83412025-03-25T01:26:31.985ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83422025-03-25T01:26:31.987ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 250.473374ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83432025-03-25T01:26:31.989ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83442025-03-25T01:26:31.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83452025-03-25T01:26:31.992ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83462025-03-25T01:26:31.992ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83472025-03-25T01:26:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
83482025-03-25T01:26:31.994ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
83492025-03-25T01:26:31.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
83502025-03-25T01:26:31.996ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83512025-03-25T01:26:31.996ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83522025-03-25T01:26:31.997ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83532025-03-25T01:26:32.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 300.250216ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83542025-03-25T01:26:32.038ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83552025-03-25T01:26:32.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83562025-03-25T01:26:32.039ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
83572025-03-25T01:26:32.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
83582025-03-25T01:26:32.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 303.159928ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83592025-03-25T01:26:32.051ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83602025-03-25T01:26:32.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83612025-03-25T01:26:32.064ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83622025-03-25T01:26:32.064ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83632025-03-25T01:26:32.064ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83642025-03-25T01:26:32.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83652025-03-25T01:26:32.065ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83662025-03-25T01:26:32.070ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83672025-03-25T01:26:32.070ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
83682025-03-25T01:26:32.070ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83692025-03-25T01:26:32.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83702025-03-25T01:26:32.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
83712025-03-25T01:26:32.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83722025-03-25T01:26:32.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83732025-03-25T01:26:32.072ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
83742025-03-25T01:26:32.072ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 335.000633ms iteration = 15 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
83752025-03-25T01:26:32.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83762025-03-25T01:26:32.073ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83772025-03-25T01:26:32.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83782025-03-25T01:26:32.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83792025-03-25T01:26:32.081ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 344.177495ms iteration = 15 status = 0
83802025-03-25T01:26:32.082ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
83812025-03-25T01:26:32.082ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83822025-03-25T01:26:32.082ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "52d82c48-57c0-420d-951e-a60a932521a3", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83832025-03-25T01:26:32.082ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83842025-03-25T01:26:32.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83852025-03-25T01:26:32.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83862025-03-25T01:26:32.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83872025-03-25T01:26:32.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83882025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 351.199725ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
83892025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
83902025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83912025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
83922025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 351.909515ms iteration = 8 status = {"generation":2}
83932025-03-25T01:26:32.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83942025-03-25T01:26:32.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83952025-03-25T01:26:32.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83962025-03-25T01:26:32.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83972025-03-25T01:26:32.095ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
83982025-03-25T01:26:32.095ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cce28ab5-3b46-4977-a8f9-8c17ef5aca90", "content-length": "1", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
83992025-03-25T01:26:32.097ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84002025-03-25T01:26:32.097ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
84012025-03-25T01:26:32.097ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84022025-03-25T01:26:32.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84032025-03-25T01:26:32.098ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8d43d8fc-627f-4476-9a41-dfe227c1a301", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84042025-03-25T01:26:32.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84052025-03-25T01:26:32.101ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84062025-03-25T01:26:32.101ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84072025-03-25T01:26:32.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84082025-03-25T01:26:32.103ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 366.283692ms iteration = 15 status = null
84092025-03-25T01:26:32.104ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 366.458654ms iteration = 15 status = {}
84102025-03-25T01:26:32.117ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84112025-03-25T01:26:32.117ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "2582a993-75c6-405d-a009-44e5a7787f0c", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84122025-03-25T01:26:32.118ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84132025-03-25T01:26:32.121ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "29465e11-82ae-47d3-a66c-37c636d8e07f", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84142025-03-25T01:26:32.121ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84152025-03-25T01:26:32.123ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
84162025-03-25T01:26:32.123ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 385.940462ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
84172025-03-25T01:26:32.125ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
84182025-03-25T01:26:32.125ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 388.134544ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
84192025-03-25T01:26:32.127ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84202025-03-25T01:26:32.127ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84212025-03-25T01:26:32.127ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 389.633985ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84222025-03-25T01:26:32.130ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84232025-03-25T01:26:32.131ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84242025-03-25T01:26:32.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84252025-03-25T01:26:32.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84262025-03-25T01:26:32.132ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 394.964922ms iteration = 15 status = {}
84272025-03-25T01:26:32.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84282025-03-25T01:26:32.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84292025-03-25T01:26:32.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84302025-03-25T01:26:32.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84312025-03-25T01:26:32.146ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
84322025-03-25T01:26:32.146ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
84332025-03-25T01:26:32.146ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
84342025-03-25T01:26:32.146ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 409.317467ms iteration = 8 status = {"generation":1}
84352025-03-25T01:26:32.147ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
84362025-03-25T01:26:32.147ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 409.972817ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
84372025-03-25T01:26:32.164ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84382025-03-25T01:26:32.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84392025-03-25T01:26:32.166ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84402025-03-25T01:26:32.169ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84412025-03-25T01:26:32.169ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84422025-03-25T01:26:32.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84432025-03-25T01:26:32.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84442025-03-25T01:26:32.173ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84452025-03-25T01:26:32.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84462025-03-25T01:26:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84472025-03-25T01:26:32.175ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84482025-03-25T01:26:32.175ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "349803f7-4946-491c-8ab4-c487c9de07bf", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84492025-03-25T01:26:32.175ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84502025-03-25T01:26:32.177ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "0780276a-df34-482e-9b42-d99ee4da4682", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84512025-03-25T01:26:32.177ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84522025-03-25T01:26:32.178ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "65a7ed5c-71d3-4ac8-8ecb-01c34e7f7dda", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84532025-03-25T01:26:32.178ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84542025-03-25T01:26:32.180ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84552025-03-25T01:26:32.180ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 443.480736ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
84562025-03-25T01:26:32.304ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84572025-03-25T01:26:32.304ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "62ba5532-d9f2-451b-a647-ecfcf0619d7b", "content-length": "691", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84582025-03-25T01:26:32.304ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
84592025-03-25T01:26:32.304ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
84602025-03-25T01:26:32.304ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
84612025-03-25T01:26:32.305ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 568.549065ms iteration = 15 status = {}
84622025-03-25T01:26:32.312ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84632025-03-25T01:26:32.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84642025-03-25T01:26:32.315ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
84652025-03-25T01:26:32.315ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84662025-03-25T01:26:32.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84672025-03-25T01:26:32.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84682025-03-25T01:26:32.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a13a0aee-35eb-4eae-a45e-b13104b30c14", "content-length": "134", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84692025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84702025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
84712025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84722025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84732025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84742025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84752025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84762025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84772025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84782025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84792025-03-25T01:26:32.324ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
84802025-03-25T01:26:32.324ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84812025-03-25T01:26:32.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84822025-03-25T01:26:32.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84832025-03-25T01:26:32.327ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8960a94e-6ec0-487f-9fcf-b9d2508bd462", "content-length": "2", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84842025-03-25T01:26:32.327ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84852025-03-25T01:26:32.327ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "163d7221-8012-47da-bb82-aaef50963ad8", "content-length": "51", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84862025-03-25T01:26:32.327ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
84872025-03-25T01:26:32.327ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84882025-03-25T01:26:32.522ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a4dda64-c28d-4090-ae78-bf34ea86a5c2", "date": "Tue, 25 Mar 2025 01:26:32 GMT"} })
84892025-03-25T01:26:32.522ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
84902025-03-25T01:26:32.522ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84912025-03-25T01:26:32.523ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee672b1f-1f95-440e-ab36-2d24c7fc1832", "content-length": "682", "date": "Tue, 25 Mar 2025 01:26:31 GMT"} })
84922025-03-25T01:26:32.523ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84932025-03-25T01:26:32.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84942025-03-25T01:26:32.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84952025-03-25T01:26:32.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84962025-03-25T01:26:32.531ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84972025-03-25T01:26:32.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84982025-03-25T01:26:32.533ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84992025-03-25T01:26:32.533ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85002025-03-25T01:26:32.541ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 804.229967ms iteration = 15 status = {}
85012025-03-25T01:26:32.567ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1072296-675f-4bd1-83df-23bb7e9c40d8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85022025-03-25T01:26:32.567ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1072296-675f-4bd1-83df-23bb7e9c40d8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85032025-03-25T01:26:32.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8428 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c1072296-675f-4bd1-83df-23bb7e9c40d8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85042025-03-25T01:26:33.595ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fada3ff4-59e5-4ea0-847d-52a987483a51 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85052025-03-25T01:26:33.595ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fada3ff4-59e5-4ea0-847d-52a987483a51 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85062025-03-25T01:26:33.597ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2439 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fada3ff4-59e5-4ea0-847d-52a987483a51 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85072025-03-25T01:26:34.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e458bb51-3131-4d19-a790-96411c606f8a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85082025-03-25T01:26:34.618ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e458bb51-3131-4d19-a790-96411c606f8a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85092025-03-25T01:26:34.620ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e458bb51-3131-4d19-a790-96411c606f8a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85102025-03-25T01:26:35.641ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 284f8c5c-38b8-486e-98b6-0bfec7e56f74 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85112025-03-25T01:26:35.641ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 284f8c5c-38b8-486e-98b6-0bfec7e56f74 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85122025-03-25T01:26:35.643ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 284f8c5c-38b8-486e-98b6-0bfec7e56f74 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85132025-03-25T01:26:35.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 434 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = fe180118-de0d-45f6-85b7-ea850a86bd09 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
85142025-03-25T01:26:36.663ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06c83467-c43f-4c3b-9465-d601e442a835 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85152025-03-25T01:26:36.664ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06c83467-c43f-4c3b-9465-d601e442a835 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85162025-03-25T01:26:36.666ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3070 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 06c83467-c43f-4c3b-9465-d601e442a835 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85172025-03-25T01:26:37.687ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 04c1c4c3-44e6-4833-9e2d-14cb16ea1f5f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85182025-03-25T01:26:37.687ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 04c1c4c3-44e6-4833-9e2d-14cb16ea1f5f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85192025-03-25T01:26:37.689ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1956 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 04c1c4c3-44e6-4833-9e2d-14cb16ea1f5f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85202025-03-25T01:26:38.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2eaa4665-7a0c-4836-b71b-973c8f6cb247 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85212025-03-25T01:26:38.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2eaa4665-7a0c-4836-b71b-973c8f6cb247 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85222025-03-25T01:26:38.711ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1991 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2eaa4665-7a0c-4836-b71b-973c8f6cb247 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85232025-03-25T01:26:39.731ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5f983ba8-0f3b-4f44-b722-c0b777e50084 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85242025-03-25T01:26:39.731ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5f983ba8-0f3b-4f44-b722-c0b777e50084 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85252025-03-25T01:26:39.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1971 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5f983ba8-0f3b-4f44-b722-c0b777e50084 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85262025-03-25T01:26:40.754ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7598898-84dc-4f31-a27f-30b69f16a69d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85272025-03-25T01:26:40.754ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7598898-84dc-4f31-a27f-30b69f16a69d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85282025-03-25T01:26:40.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2154 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7598898-84dc-4f31-a27f-30b69f16a69d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85292025-03-25T01:26:41.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
85302025-03-25T01:26:41.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85312025-03-25T01:26:41.737ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85322025-03-25T01:26:41.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
85332025-03-25T01:26:41.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85342025-03-25T01:26:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85352025-03-25T01:26:41.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85362025-03-25T01:26:41.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85372025-03-25T01:26:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85382025-03-25T01:26:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85392025-03-25T01:26:41.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85402025-03-25T01:26:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85412025-03-25T01:26:41.742ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.995497ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85422025-03-25T01:26:41.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85432025-03-25T01:26:41.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85442025-03-25T01:26:41.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85452025-03-25T01:26:41.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
85462025-03-25T01:26:41.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85472025-03-25T01:26:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85482025-03-25T01:26:41.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
85492025-03-25T01:26:41.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.344845ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
85502025-03-25T01:26:41.776ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 384baecc-cf9e-4ed5-8aa1-9d61b664b7e9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85512025-03-25T01:26:41.776ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 384baecc-cf9e-4ed5-8aa1-9d61b664b7e9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85522025-03-25T01:26:41.778ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1657 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 384baecc-cf9e-4ed5-8aa1-9d61b664b7e9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85532025-03-25T01:26:42.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e5e60f9-073a-4649-83b5-909e924a8f08 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85542025-03-25T01:26:42.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e5e60f9-073a-4649-83b5-909e924a8f08 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85552025-03-25T01:26:42.801ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2099 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e5e60f9-073a-4649-83b5-909e924a8f08 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85562025-03-25T01:26:43.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 81818346-5182-4c36-ac01-80f54f546507 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85572025-03-25T01:26:43.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 81818346-5182-4c36-ac01-80f54f546507 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85582025-03-25T01:26:43.823ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1867 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 81818346-5182-4c36-ac01-80f54f546507 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85592025-03-25T01:26:44.845ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 84853ba7-774c-4472-88a7-be9f75231709 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85602025-03-25T01:26:44.845ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 84853ba7-774c-4472-88a7-be9f75231709 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85612025-03-25T01:26:44.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2091 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 84853ba7-774c-4472-88a7-be9f75231709 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85622025-03-25T01:26:45.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 509 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 5c7358fd-1a0d-457a-9551-d824c18e83bb response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
85632025-03-25T01:26:45.868ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b1bc367-64fa-4828-8fa8-c016b3faac7e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85642025-03-25T01:26:45.868ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b1bc367-64fa-4828-8fa8-c016b3faac7e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85652025-03-25T01:26:45.870ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2519 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b1bc367-64fa-4828-8fa8-c016b3faac7e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85662025-03-25T01:26:46.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac82814d-d3f7-456a-ba28-4bf53241e246 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85672025-03-25T01:26:46.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac82814d-d3f7-456a-ba28-4bf53241e246 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85682025-03-25T01:26:46.894ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2524 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ac82814d-d3f7-456a-ba28-4bf53241e246 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85692025-03-25T01:26:47.915ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fdf5af67-1129-4c6a-b539-f7931f345540 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85702025-03-25T01:26:47.915ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fdf5af67-1129-4c6a-b539-f7931f345540 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85712025-03-25T01:26:47.917ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fdf5af67-1129-4c6a-b539-f7931f345540 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85722025-03-25T01:26:48.938ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad14f061-b58e-4ad1-8c20-a9b5cef9a146 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85732025-03-25T01:26:48.938ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad14f061-b58e-4ad1-8c20-a9b5cef9a146 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85742025-03-25T01:26:48.940ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2199 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad14f061-b58e-4ad1-8c20-a9b5cef9a146 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85752025-03-25T01:26:49.961ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c9ab80e-8fe2-44e2-9f5b-9143957af1d1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85762025-03-25T01:26:49.961ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c9ab80e-8fe2-44e2-9f5b-9143957af1d1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85772025-03-25T01:26:49.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2675 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5c9ab80e-8fe2-44e2-9f5b-9143957af1d1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85782025-03-25T01:26:50.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9d7206d-09ad-412e-b300-a98589f26182 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85792025-03-25T01:26:50.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9d7206d-09ad-412e-b300-a98589f26182 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85802025-03-25T01:26:50.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a9d7206d-09ad-412e-b300-a98589f26182 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
85812025-03-25T01:26:51.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
85822025-03-25T01:26:51.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85832025-03-25T01:26:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85842025-03-25T01:26:51.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
85852025-03-25T01:26:51.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85862025-03-25T01:26:51.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85872025-03-25T01:26:51.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85882025-03-25T01:26:51.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85892025-03-25T01:26:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85902025-03-25T01:26:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85912025-03-25T01:26:51.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85922025-03-25T01:26:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85932025-03-25T01:26:51.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85942025-03-25T01:26:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85952025-03-25T01:26:51.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85962025-03-25T01:26:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
85972025-03-25T01:26:51.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85982025-03-25T01:26:51.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85992025-03-25T01:26:51.756ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
86002025-03-25T01:26:51.756ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.518896ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
86012025-03-25T01:26:51.769ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.45421ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86022025-03-25T01:26:52.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fe98813b-82e6-4547-9ea0-69b88981e555 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86032025-03-25T01:26:52.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fe98813b-82e6-4547-9ea0-69b88981e555 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86042025-03-25T01:26:52.007ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1800 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fe98813b-82e6-4547-9ea0-69b88981e555 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86052025-03-25T01:26:53.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8d4d8a1d-dd47-4c1e-8b89-e6fe3a626c8b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86062025-03-25T01:26:53.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8d4d8a1d-dd47-4c1e-8b89-e6fe3a626c8b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86072025-03-25T01:26:53.031ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1975 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8d4d8a1d-dd47-4c1e-8b89-e6fe3a626c8b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86082025-03-25T01:26:54.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f1ef049-07ba-45bc-ac79-998f7959b951 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86092025-03-25T01:26:54.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f1ef049-07ba-45bc-ac79-998f7959b951 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86102025-03-25T01:26:54.052ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2157 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f1ef049-07ba-45bc-ac79-998f7959b951 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86112025-03-25T01:26:55.072ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b4880c-a0bd-4952-97cd-c9e4dcd862b9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86122025-03-25T01:26:55.073ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b4880c-a0bd-4952-97cd-c9e4dcd862b9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86132025-03-25T01:26:55.074ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2260 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 63b4880c-a0bd-4952-97cd-c9e4dcd862b9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86142025-03-25T01:26:55.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 437 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = d1b41480-1c39-447c-9695-7ee031b9fabc response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
86152025-03-25T01:26:56.093ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20339c84-5304-4773-bdda-3a74cf499d72 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86162025-03-25T01:26:56.093ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20339c84-5304-4773-bdda-3a74cf499d72 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86172025-03-25T01:26:56.095ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1994 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20339c84-5304-4773-bdda-3a74cf499d72 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86182025-03-25T01:26:57.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e2b8a9e-e0fe-4290-be32-33db2c3b0fb2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86192025-03-25T01:26:57.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e2b8a9e-e0fe-4290-be32-33db2c3b0fb2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86202025-03-25T01:26:57.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2565 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5e2b8a9e-e0fe-4290-be32-33db2c3b0fb2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86212025-03-25T01:26:58.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fa56da3-1899-4c3b-8d51-1e54b2ec6d46 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86222025-03-25T01:26:58.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fa56da3-1899-4c3b-8d51-1e54b2ec6d46 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86232025-03-25T01:26:58.138ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fa56da3-1899-4c3b-8d51-1e54b2ec6d46 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86242025-03-25T01:26:59.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f30e7169-dc4f-4458-b5c7-3d9ac03795e7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86252025-03-25T01:26:59.157ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f30e7169-dc4f-4458-b5c7-3d9ac03795e7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86262025-03-25T01:26:59.158ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2088 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f30e7169-dc4f-4458-b5c7-3d9ac03795e7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86272025-03-25T01:27:00.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18e25489-d8ce-4d99-bac9-080fc4872ec6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86282025-03-25T01:27:00.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18e25489-d8ce-4d99-bac9-080fc4872ec6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86292025-03-25T01:27:00.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2169 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 18e25489-d8ce-4d99-bac9-080fc4872ec6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86302025-03-25T01:27:01.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50c54ed9-e0d3-4e89-8b39-870722a3feed roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86312025-03-25T01:27:01.203ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50c54ed9-e0d3-4e89-8b39-870722a3feed resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86322025-03-25T01:27:01.204ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1969 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 50c54ed9-e0d3-4e89-8b39-870722a3feed response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
86332025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
86342025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
86352025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86362025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86372025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 16 reason = Timeout
86382025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
86392025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
86402025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86412025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
86422025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
86432025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86442025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86452025-03-25T01:27:01.737ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
86462025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86472025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
86482025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
86492025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86502025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
86512025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86522025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86532025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86542025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86552025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
86562025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86572025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86582025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86592025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86602025-03-25T01:27:01.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86612025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
86622025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
86632025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86642025-03-25T01:27:01.739ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86652025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86662025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 16 reason = Timeout
86672025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
86682025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
86692025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86702025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
86712025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86722025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
86732025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
86742025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
86752025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
86762025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
86772025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86782025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86792025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
86802025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86812025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86822025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
86832025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
86842025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86852025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
86862025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86872025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86882025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86892025-03-25T01:27:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86902025-03-25T01:27:01.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86912025-03-25T01:27:01.741ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86922025-03-25T01:27:01.742ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.323212ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86932025-03-25T01:27:01.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 456059133 } })
86942025-03-25T01:27:01.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
86952025-03-25T01:27:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86962025-03-25T01:27:01.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86972025-03-25T01:27:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86982025-03-25T01:27:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
86992025-03-25T01:27:01.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87002025-03-25T01:27:01.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87012025-03-25T01:27:01.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87022025-03-25T01:27:01.751ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87032025-03-25T01:27:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
87042025-03-25T01:27:01.751ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87052025-03-25T01:27:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87062025-03-25T01:27:01.753ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87072025-03-25T01:27:01.753ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87082025-03-25T01:27:01.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87092025-03-25T01:27:01.754ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 15.4197ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
87102025-03-25T01:27:01.754ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87112025-03-25T01:27:01.755ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 467948713 } })
87122025-03-25T01:27:01.755ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
87132025-03-25T01:27:01.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87142025-03-25T01:27:01.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87152025-03-25T01:27:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87162025-03-25T01:27:01.764ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87172025-03-25T01:27:01.765ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87182025-03-25T01:27:01.765ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1325, tv_nsec: 478497435 } })
87192025-03-25T01:27:01.765ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
87202025-03-25T01:27:01.768ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87212025-03-25T01:27:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87222025-03-25T01:27:01.769ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87232025-03-25T01:27:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87242025-03-25T01:27:01.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87252025-03-25T01:27:01.772ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87262025-03-25T01:27:01.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
87272025-03-25T01:27:01.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87282025-03-25T01:27:01.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87292025-03-25T01:27:01.776ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87302025-03-25T01:27:01.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87312025-03-25T01:27:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87322025-03-25T01:27:01.797ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
87332025-03-25T01:27:01.797ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.40665ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
87342025-03-25T01:27:01.803ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87352025-03-25T01:27:01.806ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87362025-03-25T01:27:01.806ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87372025-03-25T01:27:01.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87382025-03-25T01:27:01.810ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 71.054647ms iteration = 16 status = {"errors":[],"requests_created_ok":[]}
87392025-03-25T01:27:01.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87402025-03-25T01:27:01.810ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87412025-03-25T01:27:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87422025-03-25T01:27:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87432025-03-25T01:27:01.811ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87442025-03-25T01:27:01.811ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87452025-03-25T01:27:01.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87462025-03-25T01:27:01.811ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87472025-03-25T01:27:01.812ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87482025-03-25T01:27:01.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.366655ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
87492025-03-25T01:27:01.812ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.247688ms iteration = 16 status = {"errors":[],"finish_invoked_ok":[]}
87502025-03-25T01:27:01.815ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87512025-03-25T01:27:01.815ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87522025-03-25T01:27:01.816ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
87532025-03-25T01:27:01.816ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
87542025-03-25T01:27:01.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87552025-03-25T01:27:01.819ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87562025-03-25T01:27:01.819ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87572025-03-25T01:27:01.819ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87582025-03-25T01:27:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87592025-03-25T01:27:01.823ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87602025-03-25T01:27:01.823ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87612025-03-25T01:27:01.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87622025-03-25T01:27:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87632025-03-25T01:27:01.825ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87642025-03-25T01:27:01.825ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87652025-03-25T01:27:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87662025-03-25T01:27:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
87672025-03-25T01:27:01.826ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
87682025-03-25T01:27:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
87692025-03-25T01:27:01.831ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
87702025-03-25T01:27:01.832ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
87712025-03-25T01:27:01.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
87722025-03-25T01:27:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
87732025-03-25T01:27:01.833ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
87742025-03-25T01:27:01.833ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87752025-03-25T01:27:01.834ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbd7982b-caab-4747-a087-33db4947d8e6", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
87762025-03-25T01:27:01.834ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87772025-03-25T01:27:01.834ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
87782025-03-25T01:27:01.834ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 96.627712ms iteration = 16 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
87792025-03-25T01:27:01.836ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87802025-03-25T01:27:01.836ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.906887ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87812025-03-25T01:27:01.836ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87822025-03-25T01:27:01.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87832025-03-25T01:27:01.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87842025-03-25T01:27:01.842ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
87852025-03-25T01:27:01.842ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87862025-03-25T01:27:01.843ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8249030-8958-4521-b02b-6bd6dd376675", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
87872025-03-25T01:27:01.843ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87882025-03-25T01:27:01.843ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87892025-03-25T01:27:01.845ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87902025-03-25T01:27:01.845ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
87912025-03-25T01:27:01.845ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87922025-03-25T01:27:01.846ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "454f9bd8-332a-43f5-ab58-860653d9ffa1", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
87932025-03-25T01:27:01.846ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87942025-03-25T01:27:01.846ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87952025-03-25T01:27:01.846ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87962025-03-25T01:27:01.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87972025-03-25T01:27:01.848ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87982025-03-25T01:27:01.848ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
87992025-03-25T01:27:01.850ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88002025-03-25T01:27:01.850ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88012025-03-25T01:27:01.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88022025-03-25T01:27:01.864ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88032025-03-25T01:27:01.864ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88042025-03-25T01:27:01.867ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88052025-03-25T01:27:01.868ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88062025-03-25T01:27:01.878ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 139.452686ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
88072025-03-25T01:27:01.878ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
88082025-03-25T01:27:01.878ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
88092025-03-25T01:27:01.878ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 139.75559ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
88102025-03-25T01:27:01.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 142.040622ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88112025-03-25T01:27:01.881ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88122025-03-25T01:27:01.881ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
88132025-03-25T01:27:01.932ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 194.31071ms iteration = 18 status = {"physical_disks_added":0}
88142025-03-25T01:27:02.002ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88152025-03-25T01:27:02.002ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "89fca864-984e-4202-af24-4d55b50d8f68", "content-length": "691", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88162025-03-25T01:27:02.002ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
88172025-03-25T01:27:02.002ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
88182025-03-25T01:27:02.002ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
88192025-03-25T01:27:02.003ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 266.000476ms iteration = 16 status = {}
88202025-03-25T01:27:02.048ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
88212025-03-25T01:27:02.049ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e18ff933-ea9a-44a0-8403-852679e54183", "content-length": "1", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88222025-03-25T01:27:02.051ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88232025-03-25T01:27:02.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88242025-03-25T01:27:02.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88252025-03-25T01:27:02.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 319.821016ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
88262025-03-25T01:27:02.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
88272025-03-25T01:27:02.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88282025-03-25T01:27:02.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88292025-03-25T01:27:02.084ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 346.800753ms iteration = 16 status = {}
88302025-03-25T01:27:02.089ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
88312025-03-25T01:27:02.089ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88322025-03-25T01:27:02.089ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "96a22070-9ef5-48f1-a98a-59fd92a05d0b", "content-length": "372", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88332025-03-25T01:27:02.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88342025-03-25T01:27:02.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88352025-03-25T01:27:02.091ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 353.427037ms iteration = 16 status = null
88362025-03-25T01:27:02.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 354.390081ms iteration = 16 status = 0
88372025-03-25T01:27:02.137ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
88382025-03-25T01:27:02.137ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
88392025-03-25T01:27:02.157ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88402025-03-25T01:27:02.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88412025-03-25T01:27:02.160ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
88422025-03-25T01:27:02.160ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88432025-03-25T01:27:02.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88442025-03-25T01:27:02.171ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88452025-03-25T01:27:02.171ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "48d66b5b-7f29-4768-9b36-a0094ed8ad2a", "content-length": "134", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88462025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88472025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
88482025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88492025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88502025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88512025-03-25T01:27:02.171ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88522025-03-25T01:27:02.172ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88532025-03-25T01:27:02.172ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88542025-03-25T01:27:02.172ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88552025-03-25T01:27:02.172ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88562025-03-25T01:27:02.172ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
88572025-03-25T01:27:02.172ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88582025-03-25T01:27:02.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88592025-03-25T01:27:02.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88602025-03-25T01:27:02.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e002f0b-b028-4251-b6f1-c4c5b56be8b5", "content-length": "2", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88612025-03-25T01:27:02.175ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88622025-03-25T01:27:02.175ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "32ada088-2e20-4162-a343-2223a48e3c6b", "content-length": "51", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88632025-03-25T01:27:02.175ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
88642025-03-25T01:27:02.175ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88652025-03-25T01:27:02.212ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "61e23d3c-63b4-4263-856e-e1d797aedff0", "date": "Tue, 25 Mar 2025 01:27:02 GMT"} })
88662025-03-25T01:27:02.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88672025-03-25T01:27:02.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88682025-03-25T01:27:02.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88692025-03-25T01:27:02.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88702025-03-25T01:27:02.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88712025-03-25T01:27:02.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88722025-03-25T01:27:02.221ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88732025-03-25T01:27:02.221ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88742025-03-25T01:27:02.221ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "10a50b93-2e49-4094-9362-5103c756d333", "date": "Tue, 25 Mar 2025 01:27:02 GMT"} })
88752025-03-25T01:27:02.223ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 484.231409ms iteration = 16 status = {}
88762025-03-25T01:27:02.224ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d2acd050-8cda-42b7-aeca-6d49475791e8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88772025-03-25T01:27:02.224ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d2acd050-8cda-42b7-aeca-6d49475791e8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88782025-03-25T01:27:02.226ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1625 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d2acd050-8cda-42b7-aeca-6d49475791e8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88792025-03-25T01:27:02.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f13704d9-5a53-4190-b49a-920ecacfb523", "date": "Tue, 25 Mar 2025 01:27:02 GMT"} })
88802025-03-25T01:27:02.329ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
88812025-03-25T01:27:02.329ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88822025-03-25T01:27:02.329ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4941ac-08f4-474e-adae-8a83dfa42649", "content-length": "682", "date": "Tue, 25 Mar 2025 01:27:01 GMT"} })
88832025-03-25T01:27:02.329ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88842025-03-25T01:27:02.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88852025-03-25T01:27:02.332ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88862025-03-25T01:27:02.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88872025-03-25T01:27:02.336ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88882025-03-25T01:27:02.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88892025-03-25T01:27:02.338ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88902025-03-25T01:27:02.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88912025-03-25T01:27:02.346ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 608.510756ms iteration = 16 status = {}
88922025-03-25T01:27:03.252ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b030f08c-cbbe-4cf7-8234-1a9870939cab roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88932025-03-25T01:27:03.253ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b030f08c-cbbe-4cf7-8234-1a9870939cab resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88942025-03-25T01:27:03.254ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b030f08c-cbbe-4cf7-8234-1a9870939cab response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88952025-03-25T01:27:04.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 257328bc-d201-458b-95ac-f712b06add46 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88962025-03-25T01:27:04.275ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 257328bc-d201-458b-95ac-f712b06add46 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88972025-03-25T01:27:04.277ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2246 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 257328bc-d201-458b-95ac-f712b06add46 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88982025-03-25T01:27:05.298ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9fdabe1e-d58d-462f-adc5-6f6d028db083 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
88992025-03-25T01:27:05.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9fdabe1e-d58d-462f-adc5-6f6d028db083 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89002025-03-25T01:27:05.301ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2383 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9fdabe1e-d58d-462f-adc5-6f6d028db083 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89012025-03-25T01:27:05.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 548 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 6dc258ef-ade2-4536-aacf-fcb24ee91beb response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
89022025-03-25T01:27:06.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 518ea130-6afb-4187-a08c-60ea9236b1e3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89032025-03-25T01:27:06.323ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 518ea130-6afb-4187-a08c-60ea9236b1e3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89042025-03-25T01:27:06.325ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 518ea130-6afb-4187-a08c-60ea9236b1e3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89052025-03-25T01:27:07.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8dd7644c-ad7c-4c07-a603-4197d3ed93e4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89062025-03-25T01:27:07.346ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8dd7644c-ad7c-4c07-a603-4197d3ed93e4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89072025-03-25T01:27:07.347ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2218 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8dd7644c-ad7c-4c07-a603-4197d3ed93e4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89082025-03-25T01:27:08.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6fd8991-ce48-4f11-9b68-08ad64fba787 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89092025-03-25T01:27:08.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6fd8991-ce48-4f11-9b68-08ad64fba787 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89102025-03-25T01:27:08.369ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1837 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b6fd8991-ce48-4f11-9b68-08ad64fba787 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89112025-03-25T01:27:09.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5237833a-f2d9-4a41-90bc-ed9491d10a0b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89122025-03-25T01:27:09.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5237833a-f2d9-4a41-90bc-ed9491d10a0b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89132025-03-25T01:27:09.391ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2268 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5237833a-f2d9-4a41-90bc-ed9491d10a0b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89142025-03-25T01:27:10.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f02df90-b493-4287-9c76-a631e1dc17f8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89152025-03-25T01:27:10.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f02df90-b493-4287-9c76-a631e1dc17f8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89162025-03-25T01:27:10.415ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2564 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3f02df90-b493-4287-9c76-a631e1dc17f8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89172025-03-25T01:27:11.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c37117b-8054-49e4-9a3a-55c9a9ac8fbb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89182025-03-25T01:27:11.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c37117b-8054-49e4-9a3a-55c9a9ac8fbb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89192025-03-25T01:27:11.437ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1763 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9c37117b-8054-49e4-9a3a-55c9a9ac8fbb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89202025-03-25T01:27:11.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
89212025-03-25T01:27:11.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89222025-03-25T01:27:11.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89232025-03-25T01:27:11.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
89242025-03-25T01:27:11.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89252025-03-25T01:27:11.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89262025-03-25T01:27:11.775ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89272025-03-25T01:27:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89282025-03-25T01:27:11.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89292025-03-25T01:27:11.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89302025-03-25T01:27:11.779ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89312025-03-25T01:27:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89322025-03-25T01:27:11.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89332025-03-25T01:27:11.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89342025-03-25T01:27:11.814ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 75.729383ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89352025-03-25T01:27:11.819ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362025-03-25T01:27:11.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
89372025-03-25T01:27:11.822ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89382025-03-25T01:27:11.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89392025-03-25T01:27:11.830ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
89402025-03-25T01:27:11.830ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.886259ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
89412025-03-25T01:27:12.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28b6c2c2-81fe-4816-ba11-645fe4d82d7d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89422025-03-25T01:27:12.458ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28b6c2c2-81fe-4816-ba11-645fe4d82d7d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89432025-03-25T01:27:12.460ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2404 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 28b6c2c2-81fe-4816-ba11-645fe4d82d7d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89442025-03-25T01:27:13.480ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35befc76-0750-4521-afe8-ca64b18fae5b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89452025-03-25T01:27:13.481ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35befc76-0750-4521-afe8-ca64b18fae5b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89462025-03-25T01:27:13.482ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2186 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 35befc76-0750-4521-afe8-ca64b18fae5b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89472025-03-25T01:27:14.503ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 065f7671-0985-4f2d-818e-5c0133cd7866 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89482025-03-25T01:27:14.503ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 065f7671-0985-4f2d-818e-5c0133cd7866 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89492025-03-25T01:27:14.505ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2617 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 065f7671-0985-4f2d-818e-5c0133cd7866 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89502025-03-25T01:27:15.531ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1901475c-34d2-42e3-a2d8-e1d1c34500a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89512025-03-25T01:27:15.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1901475c-34d2-42e3-a2d8-e1d1c34500a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89522025-03-25T01:27:15.533ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1901475c-34d2-42e3-a2d8-e1d1c34500a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89532025-03-25T01:27:15.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 502 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 07a07d5f-9545-4759-97b5-935eafdf9bdc response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
89542025-03-25T01:27:16.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7fc837f-7a38-4b14-9932-d6c1a21baa8c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89552025-03-25T01:27:16.555ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7fc837f-7a38-4b14-9932-d6c1a21baa8c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89562025-03-25T01:27:16.556ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1589 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7fc837f-7a38-4b14-9932-d6c1a21baa8c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89572025-03-25T01:27:17.578ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 95268526-837e-4713-8178-b8889ac06ebf roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89582025-03-25T01:27:17.578ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 95268526-837e-4713-8178-b8889ac06ebf resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89592025-03-25T01:27:17.580ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2598 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 95268526-837e-4713-8178-b8889ac06ebf response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89602025-03-25T01:27:18.600ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b6a82bc-c227-404a-92f2-146399e25b91 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89612025-03-25T01:27:18.601ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b6a82bc-c227-404a-92f2-146399e25b91 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89622025-03-25T01:27:18.602ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2245 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5b6a82bc-c227-404a-92f2-146399e25b91 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89632025-03-25T01:27:19.624ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d22d3fe1-2812-41d9-8a11-b3aaecfb127d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89642025-03-25T01:27:19.624ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d22d3fe1-2812-41d9-8a11-b3aaecfb127d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89652025-03-25T01:27:19.626ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2491 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d22d3fe1-2812-41d9-8a11-b3aaecfb127d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89662025-03-25T01:27:20.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc6bc2f9-d09b-4a44-82b6-e638a4b5fac9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89672025-03-25T01:27:20.647ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc6bc2f9-d09b-4a44-82b6-e638a4b5fac9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89682025-03-25T01:27:20.649ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2148 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc6bc2f9-d09b-4a44-82b6-e638a4b5fac9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89692025-03-25T01:27:21.671ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32cd8503-0154-448d-9e05-6aedd736a770 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89702025-03-25T01:27:21.671ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32cd8503-0154-448d-9e05-6aedd736a770 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89712025-03-25T01:27:21.672ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1745 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 32cd8503-0154-448d-9e05-6aedd736a770 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89722025-03-25T01:27:21.737ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
89732025-03-25T01:27:21.737ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89742025-03-25T01:27:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89752025-03-25T01:27:21.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
89762025-03-25T01:27:21.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89772025-03-25T01:27:21.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89782025-03-25T01:27:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89792025-03-25T01:27:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89802025-03-25T01:27:21.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89812025-03-25T01:27:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89822025-03-25T01:27:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89832025-03-25T01:27:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89842025-03-25T01:27:21.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89852025-03-25T01:27:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
89862025-03-25T01:27:21.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89872025-03-25T01:27:21.747ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89882025-03-25T01:27:21.753ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
89892025-03-25T01:27:21.753ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.003019ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
89902025-03-25T01:27:21.769ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89912025-03-25T01:27:21.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89922025-03-25T01:27:21.770ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.934347ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89932025-03-25T01:27:22.692ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afbe8470-7a63-40ce-b647-ca828b656603 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89942025-03-25T01:27:22.692ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afbe8470-7a63-40ce-b647-ca828b656603 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89952025-03-25T01:27:22.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = afbe8470-7a63-40ce-b647-ca828b656603 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89962025-03-25T01:27:23.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1fa99606-7f13-4115-a0b8-09fadc99dfb0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89972025-03-25T01:27:23.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1fa99606-7f13-4115-a0b8-09fadc99dfb0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89982025-03-25T01:27:23.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2666 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1fa99606-7f13-4115-a0b8-09fadc99dfb0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
89992025-03-25T01:27:24.738ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ddeb9a8-1b90-43a1-b2b6-05c7cfa5d57d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90002025-03-25T01:27:24.738ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ddeb9a8-1b90-43a1-b2b6-05c7cfa5d57d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90012025-03-25T01:27:24.740ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ddeb9a8-1b90-43a1-b2b6-05c7cfa5d57d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90022025-03-25T01:27:25.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c7caec30-fd8b-45ed-a321-9b73dbe2fef1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90032025-03-25T01:27:25.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c7caec30-fd8b-45ed-a321-9b73dbe2fef1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90042025-03-25T01:27:25.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2014 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c7caec30-fd8b-45ed-a321-9b73dbe2fef1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90052025-03-25T01:27:25.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = efd6acb9-8c49-4ecc-8c7b-3c4579800300 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
90062025-03-25T01:27:26.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f20c847c-dd58-472d-80ba-1002104bb202 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90072025-03-25T01:27:26.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f20c847c-dd58-472d-80ba-1002104bb202 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90082025-03-25T01:27:26.786ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2140 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f20c847c-dd58-472d-80ba-1002104bb202 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90092025-03-25T01:27:27.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b78d4b-0735-45c9-b253-5fc4e35c47d7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90102025-03-25T01:27:27.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b78d4b-0735-45c9-b253-5fc4e35c47d7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90112025-03-25T01:27:27.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2560 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 42b78d4b-0735-45c9-b253-5fc4e35c47d7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90122025-03-25T01:27:28.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7d09493-e245-48e2-9800-da438d0cae2a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90132025-03-25T01:27:28.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7d09493-e245-48e2-9800-da438d0cae2a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90142025-03-25T01:27:28.833ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1980 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7d09493-e245-48e2-9800-da438d0cae2a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90152025-03-25T01:27:29.852ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e30d9836-88c7-4f8b-819a-e416b565ecc5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90162025-03-25T01:27:29.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e30d9836-88c7-4f8b-819a-e416b565ecc5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90172025-03-25T01:27:29.854ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2068 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e30d9836-88c7-4f8b-819a-e416b565ecc5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90182025-03-25T01:27:30.757ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:33191
90192025-03-25T01:27:30.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = efe3fa56-2b9a-4226-a763-139cad644c2b roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
90202025-03-25T01:27:30.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = efe3fa56-2b9a-4226-a763-139cad644c2b resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
90212025-03-25T01:27:30.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3082 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = efe3fa56-2b9a-4226-a763-139cad644c2b response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
90222025-03-25T01:27:30.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = 50886704-6da9-4f44-ad37-eb1af52c9bd4 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
90232025-03-25T01:27:30.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = 50886704-6da9-4f44-ad37-eb1af52c9bd4 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
90242025-03-25T01:27:30.763ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2000 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = 50886704-6da9-4f44-ad37-eb1af52c9bd4 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
90252025-03-25T01:27:30.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 10a08713-1398-4112-b081-63ad45c71b76 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90262025-03-25T01:27:30.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 10a08713-1398-4112-b081-63ad45c71b76 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90272025-03-25T01:27:30.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 10a08713-1398-4112-b081-63ad45c71b76 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
90282025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
90292025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
90302025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90312025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
90322025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
90332025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
90342025-03-25T01:27:31.738ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
90352025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
90362025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90372025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
90382025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90392025-03-25T01:27:31.738ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:17:31.738365786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
90402025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
90412025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
90422025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
90432025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
90442025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
90452025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90462025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
90472025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90482025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
90492025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
90502025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90512025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
90522025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
90532025-03-25T01:27:31.738ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
90542025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
90552025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.87\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
90562025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
90572025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
90582025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
90592025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 17 reason = Timeout
90602025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90612025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
90622025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
90632025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90642025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
90652025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
90662025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90672025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
90682025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
90692025-03-25T01:27:31.738ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
90702025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90712025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
90722025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
90732025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90742025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
90752025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
90762025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 17 reason = Timeout
90772025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
90782025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
90792025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
90802025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
90812025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90822025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
90832025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
90842025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
90852025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
90862025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
90872025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90882025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
90892025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90902025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90912025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90922025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
90932025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
90942025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90952025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90962025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
90972025-03-25T01:27:31.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90982025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90992025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91002025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91012025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91022025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91032025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
91042025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91052025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91062025-03-25T01:27:31.739ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 451578509 } })
91072025-03-25T01:27:31.739ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 451633230 } })
91082025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91092025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91102025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91112025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91122025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
91132025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
91142025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91152025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
91162025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91172025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
91182025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
91192025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
91202025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91212025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
91222025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
91232025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.303269ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
91242025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
91252025-03-25T01:27:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.600733ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
91262025-03-25T01:27:31.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91272025-03-25T01:27:31.741ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:17:31.738365786 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
91282025-03-25T01:27:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.452159ms iteration = 9 status = {"expiration":"2025-03-25T01:17:31.738365786Z","pruned":[]}
91292025-03-25T01:27:31.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91302025-03-25T01:27:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91312025-03-25T01:27:31.742ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
91322025-03-25T01:27:31.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91332025-03-25T01:27:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91342025-03-25T01:27:31.743ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.958091ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
91352025-03-25T01:27:31.744ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91362025-03-25T01:27:31.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91372025-03-25T01:27:31.745ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 458302245 } })
91382025-03-25T01:27:31.746ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
91392025-03-25T01:27:31.747ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91402025-03-25T01:27:31.747ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 460325725 } })
91412025-03-25T01:27:31.748ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
91422025-03-25T01:27:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
91432025-03-25T01:27:31.749ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91442025-03-25T01:27:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91452025-03-25T01:27:31.754ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 15.988369ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
91462025-03-25T01:27:31.807ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91472025-03-25T01:27:31.811ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91482025-03-25T01:27:31.811ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91492025-03-25T01:27:31.811ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91502025-03-25T01:27:31.811ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91512025-03-25T01:27:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
91522025-03-25T01:27:31.814ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91532025-03-25T01:27:31.814ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91542025-03-25T01:27:31.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91552025-03-25T01:27:31.815ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91562025-03-25T01:27:31.817ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
91572025-03-25T01:27:31.818ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
91582025-03-25T01:27:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
91592025-03-25T01:27:31.818ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.556369ms iteration = 17 status = {"errors":[],"finish_invoked_ok":[]}
91602025-03-25T01:27:31.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
91612025-03-25T01:27:31.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
91622025-03-25T01:27:31.820ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91632025-03-25T01:27:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
91642025-03-25T01:27:31.821ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91652025-03-25T01:27:31.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91662025-03-25T01:27:31.821ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1355, tv_nsec: 534361284 } })
91672025-03-25T01:27:31.822ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
91682025-03-25T01:27:31.822ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91692025-03-25T01:27:31.823ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91702025-03-25T01:27:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91712025-03-25T01:27:31.825ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
91722025-03-25T01:27:31.825ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
91732025-03-25T01:27:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
91742025-03-25T01:27:31.826ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91752025-03-25T01:27:31.826ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
91762025-03-25T01:27:31.826ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91772025-03-25T01:27:31.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91782025-03-25T01:27:31.828ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
91792025-03-25T01:27:31.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
91802025-03-25T01:27:31.829ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91812025-03-25T01:27:31.829ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91822025-03-25T01:27:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91832025-03-25T01:27:31.831ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91842025-03-25T01:27:31.831ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
91852025-03-25T01:27:31.831ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91862025-03-25T01:27:31.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91872025-03-25T01:27:31.835ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
91882025-03-25T01:27:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
91892025-03-25T01:27:31.836ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 97.86111ms iteration = 17 status = {"errors":[],"requests_created_ok":[]}
91902025-03-25T01:27:31.836ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
91912025-03-25T01:27:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
91922025-03-25T01:27:31.837ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
91932025-03-25T01:27:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
91942025-03-25T01:27:31.837ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91952025-03-25T01:27:31.838ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91962025-03-25T01:27:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
91972025-03-25T01:27:31.839ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91982025-03-25T01:27:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
91992025-03-25T01:27:31.840ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
92002025-03-25T01:27:31.840ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92012025-03-25T01:27:31.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92022025-03-25T01:27:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
92032025-03-25T01:27:31.842ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92042025-03-25T01:27:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92052025-03-25T01:27:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
92062025-03-25T01:27:31.842ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92072025-03-25T01:27:31.843ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92082025-03-25T01:27:31.843ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
92092025-03-25T01:27:31.843ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
92102025-03-25T01:27:31.843ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 105.170795ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
92112025-03-25T01:27:31.846ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92122025-03-25T01:27:31.849ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92132025-03-25T01:27:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92142025-03-25T01:27:31.849ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 110.598433ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
92152025-03-25T01:27:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
92162025-03-25T01:27:31.850ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92172025-03-25T01:27:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92182025-03-25T01:27:31.852ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 113.073249ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92192025-03-25T01:27:31.856ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
92202025-03-25T01:27:31.856ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 117.656823ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
92212025-03-25T01:27:31.868ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
92222025-03-25T01:27:31.868ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.066901ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
92232025-03-25T01:27:31.881ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
92242025-03-25T01:27:31.882ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92252025-03-25T01:27:31.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
92262025-03-25T01:27:31.882ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92272025-03-25T01:27:31.888ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92282025-03-25T01:27:31.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92292025-03-25T01:27:31.891ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
92302025-03-25T01:27:31.891ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
92312025-03-25T01:27:31.891ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
92322025-03-25T01:27:31.891ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
92332025-03-25T01:27:31.891ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
92342025-03-25T01:27:31.893ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92352025-03-25T01:27:31.895ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
92362025-03-25T01:27:31.895ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
92372025-03-25T01:27:31.895ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 156.924256ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
92382025-03-25T01:27:31.898ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 527caa90-fb6c-49dc-b502-56cd1254de40 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
92392025-03-25T01:27:31.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 527caa90-fb6c-49dc-b502-56cd1254de40 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
92402025-03-25T01:27:31.902ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 164.28117ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92412025-03-25T01:27:31.903ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 5174 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 527caa90-fb6c-49dc-b502-56cd1254de40 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
92422025-03-25T01:27:31.903ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
92432025-03-25T01:27:31.903ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
92442025-03-25T01:27:31.903ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92452025-03-25T01:27:31.903ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92462025-03-25T01:27:31.906ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92472025-03-25T01:27:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
92482025-03-25T01:27:31.906ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
92492025-03-25T01:27:31.906ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
92502025-03-25T01:27:31.909ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92512025-03-25T01:27:31.912ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 173.882378ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
92522025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
92532025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
92542025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
92552025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92562025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92572025-03-25T01:27:31.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92582025-03-25T01:27:31.917ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92592025-03-25T01:27:31.917ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92602025-03-25T01:27:31.918ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92612025-03-25T01:27:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
92622025-03-25T01:27:31.919ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92632025-03-25T01:27:31.919ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92642025-03-25T01:27:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92652025-03-25T01:27:31.921ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
92662025-03-25T01:27:31.921ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
92672025-03-25T01:27:31.921ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
92682025-03-25T01:27:31.921ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
92692025-03-25T01:27:31.921ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92702025-03-25T01:27:31.922ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92712025-03-25T01:27:31.922ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92722025-03-25T01:27:31.922ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a09d562-3683-480c-a746-fdb69b7be1b5", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:31 GMT"} })
92732025-03-25T01:27:31.922ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92742025-03-25T01:27:31.922ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92752025-03-25T01:27:31.924ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92762025-03-25T01:27:31.924ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
92772025-03-25T01:27:31.924ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
92782025-03-25T01:27:31.924ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92792025-03-25T01:27:31.925ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92802025-03-25T01:27:31.927ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92812025-03-25T01:27:31.930ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
92822025-03-25T01:27:31.930ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
92832025-03-25T01:27:31.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
92842025-03-25T01:27:31.933ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
92852025-03-25T01:27:31.933ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
92862025-03-25T01:27:31.933ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
92872025-03-25T01:27:31.933ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 195.350005ms iteration = 9 status = {"generation":1}
92882025-03-25T01:27:31.940ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92892025-03-25T01:27:31.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92902025-03-25T01:27:31.941ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
92912025-03-25T01:27:31.941ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
92922025-03-25T01:27:31.942ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dfdb1cc4-eb60-4a2c-bf1f-30c64f36971f", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:31 GMT"} })
92932025-03-25T01:27:31.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
92942025-03-25T01:27:31.943ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
92952025-03-25T01:27:31.945ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92962025-03-25T01:27:31.948ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
92972025-03-25T01:27:31.948ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92982025-03-25T01:27:31.948ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92992025-03-25T01:27:31.949ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93002025-03-25T01:27:31.950ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 211.674669ms iteration = 17 status = 0
93012025-03-25T01:27:31.950ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93022025-03-25T01:27:31.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93032025-03-25T01:27:31.951ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93042025-03-25T01:27:31.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93052025-03-25T01:27:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93062025-03-25T01:27:31.952ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93072025-03-25T01:27:31.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93082025-03-25T01:27:31.953ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93092025-03-25T01:27:31.953ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
93102025-03-25T01:27:31.953ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 215.067177ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
93112025-03-25T01:27:31.953ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
93122025-03-25T01:27:31.953ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
93132025-03-25T01:27:31.954ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93142025-03-25T01:27:31.954ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93152025-03-25T01:27:31.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
93162025-03-25T01:27:31.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93172025-03-25T01:27:31.956ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93182025-03-25T01:27:31.956ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 217.480642ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
93192025-03-25T01:27:31.957ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
93202025-03-25T01:27:31.957ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93212025-03-25T01:27:31.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93222025-03-25T01:27:31.976ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
93232025-03-25T01:27:31.976ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93242025-03-25T01:27:31.976ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "84e01b9b-26ec-42d2-8a0e-45ee7bb4a5de", "content-length": "26", "date": "Tue, 25 Mar 2025 01:27:31 GMT"} })
93252025-03-25T01:27:31.976ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93262025-03-25T01:27:31.978ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
93272025-03-25T01:27:31.982ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
93282025-03-25T01:27:31.983ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 244.656411ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
93292025-03-25T01:27:31.986ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
93302025-03-25T01:27:31.986ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 248.433095ms iteration = 17 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
93312025-03-25T01:27:31.993ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
93322025-03-25T01:27:31.993ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
93332025-03-25T01:27:31.993ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93342025-03-25T01:27:31.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93352025-03-25T01:27:31.995ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93362025-03-25T01:27:31.998ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
93372025-03-25T01:27:31.998ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
93382025-03-25T01:27:31.998ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
93392025-03-25T01:27:32.000ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
93402025-03-25T01:27:32.000ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
93412025-03-25T01:27:32.000ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
93422025-03-25T01:27:32.000ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 262.386734ms iteration = 9 status = {"generation":2}
93432025-03-25T01:27:32.021ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
93442025-03-25T01:27:32.021ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 282.429332ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
93452025-03-25T01:27:32.066ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
93462025-03-25T01:27:32.067ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "a9c9587c-fa88-4b24-bbf0-85825773fba8", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
93472025-03-25T01:27:32.067ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
93482025-03-25T01:27:32.068ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4fd04f90-a614-4002-b336-b927ec93eb38", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
93492025-03-25T01:27:32.068ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
93502025-03-25T01:27:32.070ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
93512025-03-25T01:27:32.070ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 332.234614ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
93522025-03-25T01:27:32.071ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 333.254238ms iteration = 19 status = {"physical_disks_added":0}
93532025-03-25T01:27:32.127ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
93542025-03-25T01:27:32.128ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb7e9b16-b1f2-4366-bbb7-c85cbb6f204e", "content-length": "1", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
93552025-03-25T01:27:32.130ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93562025-03-25T01:27:32.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93572025-03-25T01:27:32.133ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 394.652417ms iteration = 17 status = null
93582025-03-25T01:27:32.167ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93592025-03-25T01:27:32.167ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93602025-03-25T01:27:32.168ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "df314332-3ebd-46aa-9b6d-f0540dd4a50c", "content-length": "372", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
93612025-03-25T01:27:32.168ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93622025-03-25T01:27:32.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93632025-03-25T01:27:32.188ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 450.286714ms iteration = 17 status = {}
93642025-03-25T01:27:32.190ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
93652025-03-25T01:27:32.231ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
93662025-03-25T01:27:32.231ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
93672025-03-25T01:27:32.231ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c395eb9d-685a-4334-8ab7-74a22b1bec7a", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
93682025-03-25T01:27:32.232ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93692025-03-25T01:27:32.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93702025-03-25T01:27:32.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93712025-03-25T01:27:32.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93722025-03-25T01:27:32.237ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
93732025-03-25T01:27:32.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93742025-03-25T01:27:32.238ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c16196d7-78f2-49b3-b7bb-bcc8e7fad4a6", "content-length": "691", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
93752025-03-25T01:27:32.238ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
93762025-03-25T01:27:32.238ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
93772025-03-25T01:27:32.238ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
93782025-03-25T01:27:32.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93792025-03-25T01:27:32.239ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 500.946328ms iteration = 17 status = {}
93802025-03-25T01:27:32.242ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
93812025-03-25T01:27:32.242ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93822025-03-25T01:27:32.243ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1797738b-679f-4a6f-8b7e-6d606a50d62d", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
93832025-03-25T01:27:32.244ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 505.651035ms iteration = 17 status = {}
93842025-03-25T01:27:32.335ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
93852025-03-25T01:27:32.335ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1a0cff6d-29e3-4972-a81a-3cade88e987a", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93862025-03-25T01:27:32.335ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93872025-03-25T01:27:32.337ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "7ca3b887-7309-43ed-b11e-a0df8160feeb", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93882025-03-25T01:27:32.337ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93892025-03-25T01:27:32.338ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a2d6178e-ea49-47bf-a351-dd394a032305", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93902025-03-25T01:27:32.338ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93912025-03-25T01:27:32.340ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
93922025-03-25T01:27:32.340ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 602.282538ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
93932025-03-25T01:27:32.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93942025-03-25T01:27:32.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93952025-03-25T01:27:32.376ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
93962025-03-25T01:27:32.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93972025-03-25T01:27:32.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93982025-03-25T01:27:32.387ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
93992025-03-25T01:27:32.387ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f8ff8e4-6401-46d0-a110-98bce260b6ca", "content-length": "134", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
94002025-03-25T01:27:32.387ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94012025-03-25T01:27:32.387ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
94022025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94032025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94042025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94052025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94062025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94072025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94082025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94092025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94102025-03-25T01:27:32.388ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
94112025-03-25T01:27:32.388ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94122025-03-25T01:27:32.388ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94132025-03-25T01:27:32.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94142025-03-25T01:27:32.391ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f89b7352-dd9e-4c92-b210-8f0cddfee68f", "content-length": "2", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
94152025-03-25T01:27:32.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94162025-03-25T01:27:32.391ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "4d117fe7-09c1-45de-9943-cc2ed4085a2b", "content-length": "51", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
94172025-03-25T01:27:32.391ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
94182025-03-25T01:27:32.391ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94192025-03-25T01:27:32.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5689f822-9192-48b9-930d-453e5a828c6d", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
94202025-03-25T01:27:32.483ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
94212025-03-25T01:27:32.483ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94222025-03-25T01:27:32.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1051bd8-2d66-4b6c-b3f7-c03106f2b2ee", "content-length": "682", "date": "Tue, 25 Mar 2025 01:27:32 GMT"} })
94232025-03-25T01:27:32.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94242025-03-25T01:27:32.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94252025-03-25T01:27:32.487ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94262025-03-25T01:27:32.487ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94272025-03-25T01:27:32.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94282025-03-25T01:27:32.491ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94292025-03-25T01:27:32.493ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94302025-03-25T01:27:32.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94312025-03-25T01:27:32.501ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 762.942427ms iteration = 17 status = {}
94322025-03-25T01:27:32.929ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7adb22f4-78e0-428c-aba7-a52be55fcee6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94332025-03-25T01:27:32.929ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7adb22f4-78e0-428c-aba7-a52be55fcee6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94342025-03-25T01:27:32.931ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7adb22f4-78e0-428c-aba7-a52be55fcee6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94352025-03-25T01:27:33.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e321be78-9f83-4be9-9083-4627cc42e15d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94362025-03-25T01:27:33.951ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e321be78-9f83-4be9-9083-4627cc42e15d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94372025-03-25T01:27:33.954ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2799 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e321be78-9f83-4be9-9083-4627cc42e15d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94382025-03-25T01:27:34.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebedd2c4-9937-4605-bbf8-e920285b825c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94392025-03-25T01:27:34.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebedd2c4-9937-4605-bbf8-e920285b825c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94402025-03-25T01:27:34.976ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2161 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebedd2c4-9937-4605-bbf8-e920285b825c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94412025-03-25T01:27:35.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 436 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 0ce41766-e849-46bc-bba6-8dc6887c6fb2 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
94422025-03-25T01:27:35.996ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 509364b1-e90d-4808-b6a8-62b9e4661c39 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94432025-03-25T01:27:35.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 509364b1-e90d-4808-b6a8-62b9e4661c39 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94442025-03-25T01:27:35.999ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2816 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 509364b1-e90d-4808-b6a8-62b9e4661c39 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94452025-03-25T01:27:37.019ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 678b8a1c-83ca-4ce4-944b-c0d0edc37729 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94462025-03-25T01:27:37.019ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 678b8a1c-83ca-4ce4-944b-c0d0edc37729 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94472025-03-25T01:27:37.021ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 678b8a1c-83ca-4ce4-944b-c0d0edc37729 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94482025-03-25T01:27:38.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a4d87a-23fb-4c1f-b089-a3d0b9ebf1b2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94492025-03-25T01:27:38.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a4d87a-23fb-4c1f-b089-a3d0b9ebf1b2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94502025-03-25T01:27:38.042ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49a4d87a-23fb-4c1f-b089-a3d0b9ebf1b2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94512025-03-25T01:27:39.062ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ffe49847-9918-4946-9e66-e0958f5dcbbd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94522025-03-25T01:27:39.062ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ffe49847-9918-4946-9e66-e0958f5dcbbd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94532025-03-25T01:27:39.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ffe49847-9918-4946-9e66-e0958f5dcbbd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94542025-03-25T01:27:40.086ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1a3ecf8e-c4d9-49c3-be1c-f09fca45c16d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94552025-03-25T01:27:40.086ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1a3ecf8e-c4d9-49c3-be1c-f09fca45c16d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94562025-03-25T01:27:40.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1984 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1a3ecf8e-c4d9-49c3-be1c-f09fca45c16d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94572025-03-25T01:27:41.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d20da676-2611-4572-a6a4-d8e620a041c1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94582025-03-25T01:27:41.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d20da676-2611-4572-a6a4-d8e620a041c1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94592025-03-25T01:27:41.110ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d20da676-2611-4572-a6a4-d8e620a041c1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94602025-03-25T01:27:41.738ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
94612025-03-25T01:27:41.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94622025-03-25T01:27:41.738ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94632025-03-25T01:27:41.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
94642025-03-25T01:27:41.738ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94652025-03-25T01:27:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94662025-03-25T01:27:41.767ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
94672025-03-25T01:27:41.767ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
94682025-03-25T01:27:41.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94692025-03-25T01:27:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
94702025-03-25T01:27:41.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94712025-03-25T01:27:41.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94722025-03-25T01:27:41.781ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94732025-03-25T01:27:41.781ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94742025-03-25T01:27:41.783ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94752025-03-25T01:27:41.785ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
94762025-03-25T01:27:41.785ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94772025-03-25T01:27:41.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94782025-03-25T01:27:41.795ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
94792025-03-25T01:27:41.795ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.962425ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
94802025-03-25T01:27:41.799ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.008733ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94812025-03-25T01:27:42.131ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad5909be-29f1-4fdc-87af-fe3d762d5d19 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94822025-03-25T01:27:42.131ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad5909be-29f1-4fdc-87af-fe3d762d5d19 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94832025-03-25T01:27:42.132ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1698 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ad5909be-29f1-4fdc-87af-fe3d762d5d19 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94842025-03-25T01:27:43.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ec9cc8a-f35e-48ef-8598-2ca75c8a61e8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94852025-03-25T01:27:43.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ec9cc8a-f35e-48ef-8598-2ca75c8a61e8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94862025-03-25T01:27:43.155ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2176 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ec9cc8a-f35e-48ef-8598-2ca75c8a61e8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94872025-03-25T01:27:44.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ed0599d-c268-4b03-9b72-bfd8a12b3be0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94882025-03-25T01:27:44.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ed0599d-c268-4b03-9b72-bfd8a12b3be0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94892025-03-25T01:27:44.178ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ed0599d-c268-4b03-9b72-bfd8a12b3be0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94902025-03-25T01:27:45.197ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7ab37eb-493a-4827-a2f0-50892559770c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94912025-03-25T01:27:45.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7ab37eb-493a-4827-a2f0-50892559770c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94922025-03-25T01:27:45.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b7ab37eb-493a-4827-a2f0-50892559770c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
94932025-03-25T01:27:45.757ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = bc799349-7249-4c51-ac0b-aec0b6eb6fb8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
94942025-03-25T01:27:45.758ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = bc799349-7249-4c51-ac0b-aec0b6eb6fb8 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
94952025-03-25T01:27:45.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3298 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = bc799349-7249-4c51-ac0b-aec0b6eb6fb8 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
94962025-03-25T01:27:45.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = fa46daea-ef8a-46d9-ac2c-b41b5244a657 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
94972025-03-25T01:27:45.761ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = fa46daea-ef8a-46d9-ac2c-b41b5244a657 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
94982025-03-25T01:27:45.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2697 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:33191 req_id = fa46daea-ef8a-46d9-ac2c-b41b5244a657 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
94992025-03-25T01:27:45.764ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 481 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 0228bb3c-1cff-45c9-a81e-c7b43aa0baea response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
95002025-03-25T01:27:46.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2be312d-e9f6-4b94-838a-6cd4f129b291 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95012025-03-25T01:27:46.220ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2be312d-e9f6-4b94-838a-6cd4f129b291 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95022025-03-25T01:27:46.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2323 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f2be312d-e9f6-4b94-838a-6cd4f129b291 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95032025-03-25T01:27:47.244ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49ccf2ad-6d23-449c-b5ab-08c67c8578c4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95042025-03-25T01:27:47.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49ccf2ad-6d23-449c-b5ab-08c67c8578c4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95052025-03-25T01:27:47.246ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1761 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 49ccf2ad-6d23-449c-b5ab-08c67c8578c4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95062025-03-25T01:27:48.265ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebd36b63-7992-41f3-baa5-839cfe231d8e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95072025-03-25T01:27:48.265ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebd36b63-7992-41f3-baa5-839cfe231d8e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95082025-03-25T01:27:48.267ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2655 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ebd36b63-7992-41f3-baa5-839cfe231d8e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95092025-03-25T01:27:49.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a6ba8cab-b4b2-4c1b-8636-3b17c24abac4 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95102025-03-25T01:27:49.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a6ba8cab-b4b2-4c1b-8636-3b17c24abac4 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95112025-03-25T01:27:49.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2529 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a6ba8cab-b4b2-4c1b-8636-3b17c24abac4 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95122025-03-25T01:27:50.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 21264f4f-b44f-4dca-b4cf-e4f0446e064b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95132025-03-25T01:27:50.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 21264f4f-b44f-4dca-b4cf-e4f0446e064b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95142025-03-25T01:27:50.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2114 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 21264f4f-b44f-4dca-b4cf-e4f0446e064b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95152025-03-25T01:27:51.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48804ddb-0ba5-419d-93ed-32293756cd24 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95162025-03-25T01:27:51.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48804ddb-0ba5-419d-93ed-32293756cd24 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95172025-03-25T01:27:51.335ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2124 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48804ddb-0ba5-419d-93ed-32293756cd24 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95182025-03-25T01:27:51.738ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
95192025-03-25T01:27:51.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95202025-03-25T01:27:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95212025-03-25T01:27:51.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
95222025-03-25T01:27:51.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95232025-03-25T01:27:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95242025-03-25T01:27:51.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95252025-03-25T01:27:51.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95262025-03-25T01:27:51.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95272025-03-25T01:27:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95282025-03-25T01:27:51.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95292025-03-25T01:27:51.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95302025-03-25T01:27:51.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95312025-03-25T01:27:51.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95322025-03-25T01:27:51.779ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 40.410128ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95332025-03-25T01:27:51.780ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95342025-03-25T01:27:51.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
95352025-03-25T01:27:51.782ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95362025-03-25T01:27:51.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95372025-03-25T01:27:51.791ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
95382025-03-25T01:27:51.791ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 53.423864ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
95392025-03-25T01:27:52.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d7a6b53-addc-4616-8389-1de4066373f0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95402025-03-25T01:27:52.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d7a6b53-addc-4616-8389-1de4066373f0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95412025-03-25T01:27:52.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4d7a6b53-addc-4616-8389-1de4066373f0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95422025-03-25T01:27:53.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c83c518c-0205-4e29-97d6-4dc2e3a04422 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95432025-03-25T01:27:53.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c83c518c-0205-4e29-97d6-4dc2e3a04422 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95442025-03-25T01:27:53.381ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2171 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c83c518c-0205-4e29-97d6-4dc2e3a04422 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95452025-03-25T01:27:54.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 883775da-f307-4988-86dc-282f8ff587a9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95462025-03-25T01:27:54.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 883775da-f307-4988-86dc-282f8ff587a9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95472025-03-25T01:27:54.404ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2041 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 883775da-f307-4988-86dc-282f8ff587a9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95482025-03-25T01:27:55.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55a55ce7-89fc-4963-90a5-564956e31e3d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95492025-03-25T01:27:55.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55a55ce7-89fc-4963-90a5-564956e31e3d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95502025-03-25T01:27:55.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2262 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 55a55ce7-89fc-4963-90a5-564956e31e3d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95512025-03-25T01:27:55.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 489 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 0dbd0475-7994-42c6-b821-1d189111058d response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
95522025-03-25T01:27:56.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d7adf74-85b5-4edc-a0da-850cf1052dc2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95532025-03-25T01:27:56.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d7adf74-85b5-4edc-a0da-850cf1052dc2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95542025-03-25T01:27:56.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2283 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d7adf74-85b5-4edc-a0da-850cf1052dc2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95552025-03-25T01:27:57.469ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d75bf769-c94d-47cf-9e2d-d14307f28dfd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95562025-03-25T01:27:57.469ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d75bf769-c94d-47cf-9e2d-d14307f28dfd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95572025-03-25T01:27:57.471ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2508 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d75bf769-c94d-47cf-9e2d-d14307f28dfd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95582025-03-25T01:27:58.492ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 154e279b-a18a-4492-9bfa-6d1d1ecec248 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95592025-03-25T01:27:58.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 154e279b-a18a-4492-9bfa-6d1d1ecec248 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95602025-03-25T01:27:58.494ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2201 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 154e279b-a18a-4492-9bfa-6d1d1ecec248 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95612025-03-25T01:27:59.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c42414-24ee-4c76-bb51-d37f98ae4fda roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95622025-03-25T01:27:59.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c42414-24ee-4c76-bb51-d37f98ae4fda resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95632025-03-25T01:27:59.517ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1995 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25c42414-24ee-4c76-bb51-d37f98ae4fda response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95642025-03-25T01:28:00.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c707136-3c2d-4d11-9f74-6c0f9576cd52 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95652025-03-25T01:28:00.539ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c707136-3c2d-4d11-9f74-6c0f9576cd52 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95662025-03-25T01:28:00.540ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1c707136-3c2d-4d11-9f74-6c0f9576cd52 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95672025-03-25T01:28:01.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c105322a-1fed-41f9-b02c-8394d0ae94fa roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95682025-03-25T01:28:01.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c105322a-1fed-41f9-b02c-8394d0ae94fa resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95692025-03-25T01:28:01.563ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1952 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c105322a-1fed-41f9-b02c-8394d0ae94fa response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
95702025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
95712025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
95722025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95732025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
95742025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
95752025-03-25T01:28:01.738ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
95762025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
95772025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
95782025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
95792025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95802025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
95812025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
95822025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
95832025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
95842025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
95852025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95862025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 18 reason = Timeout
95872025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95882025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
95892025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
95902025-03-25T01:28:01.739ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95912025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95922025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
95932025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95942025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95952025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
95962025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
95972025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
95982025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
95992025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
96002025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96012025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
96022025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96032025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
96042025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96052025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 18 reason = Timeout
96062025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
96072025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
96082025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96092025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96102025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96112025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96122025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96132025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96142025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96152025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96162025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96172025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96182025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96192025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96202025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96212025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96222025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96232025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96242025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
96252025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96262025-03-25T01:28:01.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96272025-03-25T01:28:01.741ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96282025-03-25T01:28:01.742ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.780024ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96292025-03-25T01:28:01.742ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 454901527 } })
96302025-03-25T01:28:01.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 455031339 } })
96312025-03-25T01:28:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96322025-03-25T01:28:01.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96332025-03-25T01:28:01.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
96342025-03-25T01:28:01.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96352025-03-25T01:28:01.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
96362025-03-25T01:28:01.745ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96372025-03-25T01:28:01.745ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96382025-03-25T01:28:01.746ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96392025-03-25T01:28:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96402025-03-25T01:28:01.748ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96412025-03-25T01:28:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96422025-03-25T01:28:01.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
96432025-03-25T01:28:01.748ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96442025-03-25T01:28:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96452025-03-25T01:28:01.749ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96462025-03-25T01:28:01.749ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96472025-03-25T01:28:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96482025-03-25T01:28:01.750ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 11.523895ms iteration = 18 status = {"errors":[],"finish_invoked_ok":[]}
96492025-03-25T01:28:01.754ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96502025-03-25T01:28:01.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
96512025-03-25T01:28:01.756ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96522025-03-25T01:28:01.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96532025-03-25T01:28:01.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96542025-03-25T01:28:01.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96552025-03-25T01:28:01.757ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1385, tv_nsec: 469514176 } })
96562025-03-25T01:28:01.758ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
96572025-03-25T01:28:01.759ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 19.964605ms iteration = 18 status = {"errors":[],"requests_created_ok":[]}
96582025-03-25T01:28:01.765ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96592025-03-25T01:28:01.768ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
96602025-03-25T01:28:01.768ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.841729ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
96612025-03-25T01:28:01.768ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96622025-03-25T01:28:01.768ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96632025-03-25T01:28:01.768ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96642025-03-25T01:28:01.809ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96652025-03-25T01:28:01.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96662025-03-25T01:28:01.815ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96672025-03-25T01:28:01.819ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
96682025-03-25T01:28:01.819ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
96692025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96702025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96712025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96722025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96732025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96742025-03-25T01:28:01.820ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96752025-03-25T01:28:01.821ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96762025-03-25T01:28:01.821ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.631802ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
96772025-03-25T01:28:01.822ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96782025-03-25T01:28:01.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96792025-03-25T01:28:01.822ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96802025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96812025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96822025-03-25T01:28:01.823ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96832025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96842025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96852025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96862025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96872025-03-25T01:28:01.823ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 84.666571ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
96882025-03-25T01:28:01.824ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96892025-03-25T01:28:01.825ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96902025-03-25T01:28:01.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96912025-03-25T01:28:01.826ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96922025-03-25T01:28:01.827ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96932025-03-25T01:28:01.827ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96942025-03-25T01:28:01.827ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96952025-03-25T01:28:01.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96962025-03-25T01:28:01.830ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96972025-03-25T01:28:01.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96982025-03-25T01:28:01.832ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96992025-03-25T01:28:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97002025-03-25T01:28:01.833ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97012025-03-25T01:28:01.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97022025-03-25T01:28:01.835ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97032025-03-25T01:28:01.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
97042025-03-25T01:28:01.838ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97052025-03-25T01:28:01.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97062025-03-25T01:28:01.852ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97072025-03-25T01:28:01.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97082025-03-25T01:28:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.944115ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97092025-03-25T01:28:01.861ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 122.096627ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97102025-03-25T01:28:01.864ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
97112025-03-25T01:28:01.864ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97122025-03-25T01:28:01.865ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "07ef44ac-42a0-4505-8196-b0f19afeeadd", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97132025-03-25T01:28:01.865ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97142025-03-25T01:28:01.866ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
97152025-03-25T01:28:01.871ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 131.873058ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
97162025-03-25T01:28:01.874ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97172025-03-25T01:28:01.874ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97182025-03-25T01:28:01.874ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97192025-03-25T01:28:01.874ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97202025-03-25T01:28:01.875ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97212025-03-25T01:28:01.877ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
97222025-03-25T01:28:01.877ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
97232025-03-25T01:28:01.877ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
97242025-03-25T01:28:01.932ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 193.494079ms iteration = 20 status = {"physical_disks_added":0}
97252025-03-25T01:28:01.942ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
97262025-03-25T01:28:01.942ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97272025-03-25T01:28:01.942ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc94cc61-ec54-448a-b152-b9ca54262f77", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97282025-03-25T01:28:01.942ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97292025-03-25T01:28:01.944ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97302025-03-25T01:28:01.959ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
97312025-03-25T01:28:01.959ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
97322025-03-25T01:28:01.960ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "060e85ba-ad46-4b01-94e8-1925a84e5af0", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97332025-03-25T01:28:01.960ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
97342025-03-25T01:28:01.963ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
97352025-03-25T01:28:01.973ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
97362025-03-25T01:28:01.973ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97372025-03-25T01:28:01.973ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd7cd014-1514-4fde-80fc-ebf0815d7f63", "content-length": "372", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97382025-03-25T01:28:01.973ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97392025-03-25T01:28:01.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97402025-03-25T01:28:01.977ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
97412025-03-25T01:28:01.977ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 238.754136ms iteration = 18 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
97422025-03-25T01:28:01.978ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97432025-03-25T01:28:01.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97442025-03-25T01:28:01.987ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
97452025-03-25T01:28:01.987ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 248.050749ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
97462025-03-25T01:28:02.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97472025-03-25T01:28:02.013ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97482025-03-25T01:28:02.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97492025-03-25T01:28:02.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97502025-03-25T01:28:02.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97512025-03-25T01:28:02.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
97522025-03-25T01:28:02.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97532025-03-25T01:28:02.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97542025-03-25T01:28:02.024ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 285.696038ms iteration = 18 status = 0
97552025-03-25T01:28:02.025ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97562025-03-25T01:28:02.025ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
97572025-03-25T01:28:02.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 286.52796ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
97582025-03-25T01:28:02.033ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
97592025-03-25T01:28:02.033ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
97602025-03-25T01:28:02.034ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f0ad966a-4db6-40d1-b561-e2290ad82b23", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97612025-03-25T01:28:02.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97622025-03-25T01:28:02.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97632025-03-25T01:28:02.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97642025-03-25T01:28:02.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97652025-03-25T01:28:02.049ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97662025-03-25T01:28:02.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97672025-03-25T01:28:02.054ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
97682025-03-25T01:28:02.054ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
97692025-03-25T01:28:02.054ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "65af4691-b1ae-42c1-83ea-728311c6804b", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97702025-03-25T01:28:02.057ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 318.191513ms iteration = 18 status = {}
97712025-03-25T01:28:02.064ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.067801ms iteration = 18 status = {}
97722025-03-25T01:28:02.066ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
97732025-03-25T01:28:02.066ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce013e7-12c8-4dc2-892b-e2bbc80c3bf1", "content-length": "1", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97742025-03-25T01:28:02.068ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
97752025-03-25T01:28:02.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
97762025-03-25T01:28:02.071ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 332.663591ms iteration = 18 status = null
97772025-03-25T01:28:02.076ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97782025-03-25T01:28:02.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
97792025-03-25T01:28:02.078ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97802025-03-25T01:28:02.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97812025-03-25T01:28:02.114ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97822025-03-25T01:28:02.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97832025-03-25T01:28:02.117ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
97842025-03-25T01:28:02.117ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97852025-03-25T01:28:02.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97862025-03-25T01:28:02.131ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
97872025-03-25T01:28:02.131ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5818c345-7c8f-4871-8b27-3cf3f2180ade", "content-length": "134", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
97882025-03-25T01:28:02.131ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
97892025-03-25T01:28:02.131ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
97902025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
97912025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
97922025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97932025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97942025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97952025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97962025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
97972025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
97982025-03-25T01:28:02.132ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
97992025-03-25T01:28:02.132ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98002025-03-25T01:28:02.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98012025-03-25T01:28:02.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
98022025-03-25T01:28:02.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0015431a-ddaf-4ce6-b292-3a590bae2d8a", "content-length": "2", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
98032025-03-25T01:28:02.135ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
98042025-03-25T01:28:02.135ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3c65826-a511-485b-baaf-a89b912fb87a", "content-length": "51", "date": "Tue, 25 Mar 2025 01:28:01 GMT"} })
98052025-03-25T01:28:02.135ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
98062025-03-25T01:28:02.135ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
98072025-03-25T01:28:02.192ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
98082025-03-25T01:28:02.206ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a17d91a-a7bb-4d69-98b4-6be41eb809a2", "content-length": "691", "date": "Tue, 25 Mar 2025 01:28:02 GMT"} })
98092025-03-25T01:28:02.206ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
98102025-03-25T01:28:02.206ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
98112025-03-25T01:28:02.206ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
98122025-03-25T01:28:02.207ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 468.537324ms iteration = 18 status = {}
98132025-03-25T01:28:02.297ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "c75d8bb7-38fb-4177-96bc-2665606bbb17", "date": "Tue, 25 Mar 2025 01:28:02 GMT"} })
98142025-03-25T01:28:02.298ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
98152025-03-25T01:28:02.298ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
98162025-03-25T01:28:02.298ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4712d0bd-cdd5-4c1f-88a4-6ea2b5e18024", "content-length": "682", "date": "Tue, 25 Mar 2025 01:28:02 GMT"} })
98172025-03-25T01:28:02.298ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98182025-03-25T01:28:02.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98192025-03-25T01:28:02.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98202025-03-25T01:28:02.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98212025-03-25T01:28:02.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98222025-03-25T01:28:02.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98232025-03-25T01:28:02.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98242025-03-25T01:28:02.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98252025-03-25T01:28:02.322ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 583.601131ms iteration = 18 status = {}
98262025-03-25T01:28:02.425ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
98272025-03-25T01:28:02.425ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::b]:12221
98282025-03-25T01:28:02.455ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::b]:12221/metrics/producers
98292025-03-25T01:28:02.455ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::b]:48257
98302025-03-25T01:28:02.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48257 req_id = 156060cb-b89f-43e4-8e70-b29acb695c23 roles = RoleSet { roles: {} } uri = /metrics/producers
98312025-03-25T01:28:02.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48257 req_id = 156060cb-b89f-43e4-8e70-b29acb695c23 resource = Database result = Ok(()) uri = /metrics/producers
98322025-03-25T01:28:02.499ZINFOnexus: assigned collector to new producer collector_id = a9f260fd-b911-4f87-b07b-84934591a3eb file = nexus/src/app/oximeter.rs:76 producer_id = 3382b509-413c-4e85-971f-4b24ca64ae0c
98332025-03-25T01:28:02.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 43851 local_addr = [fd00:1122:3344:101::b]:12221 method = POST remote_addr = [fd00:1122:3344:101::b]:48257 req_id = 156060cb-b89f-43e4-8e70-b29acb695c23 response_code = 201 uri = /metrics/producers
98342025-03-25T01:28:02.499ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::b]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "156060cb-b89f-43e4-8e70-b29acb695c23", "content-length": "41", "date": "Tue, 25 Mar 2025 01:28:02 GMT"} })
98352025-03-25T01:28:02.500ZDEBGnexus (producer-registration-task): registered with nexus successfully
98362025-03-25T01:28:02.500ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
98372025-03-25T01:28:02.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25034e20-6a0f-4df7-8b56-4d809b3a05e0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98382025-03-25T01:28:02.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25034e20-6a0f-4df7-8b56-4d809b3a05e0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98392025-03-25T01:28:02.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2089 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25034e20-6a0f-4df7-8b56-4d809b3a05e0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98402025-03-25T01:28:03.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea808fdf-494f-454e-a3f6-887183161047 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98412025-03-25T01:28:03.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea808fdf-494f-454e-a3f6-887183161047 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98422025-03-25T01:28:03.607ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2359 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea808fdf-494f-454e-a3f6-887183161047 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98432025-03-25T01:28:04.629ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4eb135dd-c20a-4c45-b937-de0926c93aa9 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98442025-03-25T01:28:04.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4eb135dd-c20a-4c45-b937-de0926c93aa9 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98452025-03-25T01:28:04.630ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4eb135dd-c20a-4c45-b937-de0926c93aa9 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98462025-03-25T01:28:05.651ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9581a6e-95c1-4e90-acb8-8ea6997fe5ee roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98472025-03-25T01:28:05.651ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9581a6e-95c1-4e90-acb8-8ea6997fe5ee resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98482025-03-25T01:28:05.653ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2387 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f9581a6e-95c1-4e90-acb8-8ea6997fe5ee response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98492025-03-25T01:28:05.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = d899ddbe-4c59-42a4-89a2-ea5e9bb0eec6 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
98502025-03-25T01:28:06.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f26b48e5-5452-49e1-8a80-f835a3d04ec6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98512025-03-25T01:28:06.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f26b48e5-5452-49e1-8a80-f835a3d04ec6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98522025-03-25T01:28:06.676ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2770 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f26b48e5-5452-49e1-8a80-f835a3d04ec6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98532025-03-25T01:28:07.696ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38bfb597-440c-4d4a-8ddb-29addd77e5da roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98542025-03-25T01:28:07.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38bfb597-440c-4d4a-8ddb-29addd77e5da resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98552025-03-25T01:28:07.697ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1982 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 38bfb597-440c-4d4a-8ddb-29addd77e5da response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98562025-03-25T01:28:08.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f3f69b8-a51e-45c2-8034-d0301019ae73 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98572025-03-25T01:28:08.719ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f3f69b8-a51e-45c2-8034-d0301019ae73 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98582025-03-25T01:28:08.720ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1808 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2f3f69b8-a51e-45c2-8034-d0301019ae73 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98592025-03-25T01:28:09.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b8b253f-b38a-48d3-810b-8f91538cdfe2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98602025-03-25T01:28:09.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b8b253f-b38a-48d3-810b-8f91538cdfe2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98612025-03-25T01:28:09.741ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1571 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b8b253f-b38a-48d3-810b-8f91538cdfe2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98622025-03-25T01:28:10.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c46d0330-ea5c-4879-95f6-a7c45e60df74 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98632025-03-25T01:28:10.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c46d0330-ea5c-4879-95f6-a7c45e60df74 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98642025-03-25T01:28:10.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1944 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c46d0330-ea5c-4879-95f6-a7c45e60df74 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98652025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
98662025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
98672025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98682025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98692025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98702025-03-25T01:28:11.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98712025-03-25T01:28:11.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98722025-03-25T01:28:11.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
98732025-03-25T01:28:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
98742025-03-25T01:28:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
98752025-03-25T01:28:11.772ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98762025-03-25T01:28:11.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98772025-03-25T01:28:11.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98782025-03-25T01:28:11.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98792025-03-25T01:28:11.776ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98802025-03-25T01:28:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
98812025-03-25T01:28:11.779ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98822025-03-25T01:28:11.779ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98832025-03-25T01:28:11.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8f47bf52-f29d-42f8-bd10-691f2277c3b0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98842025-03-25T01:28:11.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8f47bf52-f29d-42f8-bd10-691f2277c3b0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98852025-03-25T01:28:11.785ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1615 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8f47bf52-f29d-42f8-bd10-691f2277c3b0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98862025-03-25T01:28:11.786ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
98872025-03-25T01:28:11.786ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.278136ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
98882025-03-25T01:28:11.807ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.667703ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
98892025-03-25T01:28:12.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25dec585-8185-4d89-9c60-d4a4aced87b6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98902025-03-25T01:28:12.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25dec585-8185-4d89-9c60-d4a4aced87b6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98912025-03-25T01:28:12.809ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2152 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 25dec585-8185-4d89-9c60-d4a4aced87b6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98922025-03-25T01:28:13.828ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb99f7f-b248-4d44-b2e2-b67b273e9b7d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98932025-03-25T01:28:13.828ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb99f7f-b248-4d44-b2e2-b67b273e9b7d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98942025-03-25T01:28:13.830ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1768 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb99f7f-b248-4d44-b2e2-b67b273e9b7d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98952025-03-25T01:28:14.851ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a110d39a-0a53-45ef-911f-57f6bf7895bd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98962025-03-25T01:28:14.851ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a110d39a-0a53-45ef-911f-57f6bf7895bd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98972025-03-25T01:28:14.852ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a110d39a-0a53-45ef-911f-57f6bf7895bd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
98982025-03-25T01:28:15.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 417 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 502885c7-befb-464e-bdbe-451f001bb945 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
98992025-03-25T01:28:15.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6063db73-f563-47a5-969b-c9c317374049 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99002025-03-25T01:28:15.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6063db73-f563-47a5-969b-c9c317374049 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99012025-03-25T01:28:15.874ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2238 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6063db73-f563-47a5-969b-c9c317374049 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99022025-03-25T01:28:16.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05ca7262-9b16-4fb0-981d-9bbf2f87af5b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99032025-03-25T01:28:16.897ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05ca7262-9b16-4fb0-981d-9bbf2f87af5b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99042025-03-25T01:28:16.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2302 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 05ca7262-9b16-4fb0-981d-9bbf2f87af5b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99052025-03-25T01:28:17.919ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4bd70c4-1c3a-48d0-a8ce-16924e894f22 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99062025-03-25T01:28:17.919ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4bd70c4-1c3a-48d0-a8ce-16924e894f22 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99072025-03-25T01:28:17.921ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2048 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e4bd70c4-1c3a-48d0-a8ce-16924e894f22 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99082025-03-25T01:28:18.941ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb69c948-72e3-4bc8-91d2-096d9a6dff4c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99092025-03-25T01:28:18.941ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb69c948-72e3-4bc8-91d2-096d9a6dff4c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99102025-03-25T01:28:18.943ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2528 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb69c948-72e3-4bc8-91d2-096d9a6dff4c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99112025-03-25T01:28:19.963ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9de73f4d-5157-474c-8616-b46a049198b8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99122025-03-25T01:28:19.963ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9de73f4d-5157-474c-8616-b46a049198b8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99132025-03-25T01:28:19.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2397 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9de73f4d-5157-474c-8616-b46a049198b8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99142025-03-25T01:28:20.984ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20ac9599-b346-4a58-a351-19455de7c911 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99152025-03-25T01:28:20.985ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20ac9599-b346-4a58-a351-19455de7c911 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99162025-03-25T01:28:20.986ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 20ac9599-b346-4a58-a351-19455de7c911 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99172025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
99182025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99192025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99202025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
99212025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99222025-03-25T01:28:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99232025-03-25T01:28:21.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99242025-03-25T01:28:21.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99252025-03-25T01:28:21.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99262025-03-25T01:28:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99272025-03-25T01:28:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99282025-03-25T01:28:21.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99292025-03-25T01:28:21.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99302025-03-25T01:28:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99312025-03-25T01:28:21.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99322025-03-25T01:28:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
99332025-03-25T01:28:21.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99342025-03-25T01:28:21.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99352025-03-25T01:28:21.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
99362025-03-25T01:28:21.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.449549ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
99372025-03-25T01:28:21.772ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.099943ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99382025-03-25T01:28:22.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe6f1d1-b3bc-4188-9193-4f1a37bb07ba roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99392025-03-25T01:28:22.007ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe6f1d1-b3bc-4188-9193-4f1a37bb07ba resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99402025-03-25T01:28:22.008ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1668 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6fe6f1d1-b3bc-4188-9193-4f1a37bb07ba response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99412025-03-25T01:28:23.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e5ec9cb-ef12-4eeb-8685-447cb589788c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99422025-03-25T01:28:23.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e5ec9cb-ef12-4eeb-8685-447cb589788c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99432025-03-25T01:28:23.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2443 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3e5ec9cb-ef12-4eeb-8685-447cb589788c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99442025-03-25T01:28:24.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6eab030-0917-465c-bdd7-ae5fe70b143e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99452025-03-25T01:28:24.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6eab030-0917-465c-bdd7-ae5fe70b143e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99462025-03-25T01:28:24.059ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2076 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e6eab030-0917-465c-bdd7-ae5fe70b143e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99472025-03-25T01:28:25.078ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a5564ed-5075-4ffe-9511-a3a236af1f4f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99482025-03-25T01:28:25.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a5564ed-5075-4ffe-9511-a3a236af1f4f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99492025-03-25T01:28:25.080ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2a5564ed-5075-4ffe-9511-a3a236af1f4f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99502025-03-25T01:28:25.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 479 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 392b2026-651c-4ec7-9e9d-b7ceaa7a82b2 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
99512025-03-25T01:28:26.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36d0513f-bf8c-4b82-a487-35c62c27eeae roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99522025-03-25T01:28:26.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36d0513f-bf8c-4b82-a487-35c62c27eeae resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99532025-03-25T01:28:26.105ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2368 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36d0513f-bf8c-4b82-a487-35c62c27eeae response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99542025-03-25T01:28:27.126ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 218b9649-4119-4733-93bb-a96ae5b96294 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99552025-03-25T01:28:27.126ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 218b9649-4119-4733-93bb-a96ae5b96294 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99562025-03-25T01:28:27.129ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2946 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 218b9649-4119-4733-93bb-a96ae5b96294 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99572025-03-25T01:28:28.150ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af983a4d-0dc6-4fcd-9e3c-cb3e38fd951d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99582025-03-25T01:28:28.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af983a4d-0dc6-4fcd-9e3c-cb3e38fd951d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99592025-03-25T01:28:28.152ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1917 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = af983a4d-0dc6-4fcd-9e3c-cb3e38fd951d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99602025-03-25T01:28:29.172ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c4c5dece-8095-4f33-9978-c94e02ab63f3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99612025-03-25T01:28:29.172ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c4c5dece-8095-4f33-9978-c94e02ab63f3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99622025-03-25T01:28:29.175ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2868 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c4c5dece-8095-4f33-9978-c94e02ab63f3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99632025-03-25T01:28:30.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4cff48af-70cc-46b0-a785-bcbe2ba384e1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99642025-03-25T01:28:30.196ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4cff48af-70cc-46b0-a785-bcbe2ba384e1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99652025-03-25T01:28:30.197ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1821 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4cff48af-70cc-46b0-a785-bcbe2ba384e1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99662025-03-25T01:28:30.759ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:32845
99672025-03-25T01:28:30.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = cd83dee4-683e-49b6-8928-2a1b99b169d8 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
99682025-03-25T01:28:30.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = cd83dee4-683e-49b6-8928-2a1b99b169d8 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
99692025-03-25T01:28:30.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3049 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = cd83dee4-683e-49b6-8928-2a1b99b169d8 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
99702025-03-25T01:28:30.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 8bb67c06-2ef0-4696-a9eb-3cd67ed2f0b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
99712025-03-25T01:28:30.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 8bb67c06-2ef0-4696-a9eb-3cd67ed2f0b2 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
99722025-03-25T01:28:30.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2296 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 8bb67c06-2ef0-4696-a9eb-3cd67ed2f0b2 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
99732025-03-25T01:28:31.217ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512af62a-fb3f-4c9b-ad00-636978b5b421 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99742025-03-25T01:28:31.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512af62a-fb3f-4c9b-ad00-636978b5b421 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99752025-03-25T01:28:31.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1539 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 512af62a-fb3f-4c9b-ad00-636978b5b421 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
99762025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
99772025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
99782025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
99792025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99802025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
99812025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
99822025-03-25T01:28:31.739ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
99832025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
99842025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 19 reason = Timeout
99852025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
99862025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
99872025-03-25T01:28:31.739ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
99882025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
99892025-03-25T01:28:31.739ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:18:31.739460169 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
99902025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 24.48\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
99912025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
99922025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
99932025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
99942025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
99952025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99962025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
99972025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
99982025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
99992025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
100002025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
100012025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
100022025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
100032025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100042025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
100052025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100062025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
100072025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100082025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
100092025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100102025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100112025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
100122025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100132025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
100142025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100152025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
100162025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
100172025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
100182025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
100192025-03-25T01:28:31.739ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100202025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100212025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
100222025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100232025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
100242025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
100252025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100262025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
100272025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
100282025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100292025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
100302025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100312025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100322025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
100332025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
100342025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
100352025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100362025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
100372025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100382025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100392025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
100402025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
100412025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100422025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
100432025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 19 reason = Timeout
100442025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100452025-03-25T01:28:31.739ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
100462025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
100472025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100482025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
100492025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100502025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100512025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100522025-03-25T01:28:31.740ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 451846743 } })
100532025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100542025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100552025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100562025-03-25T01:28:31.740ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 451881244 } })
100572025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100582025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100592025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100602025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100612025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100622025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
100632025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100642025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
100652025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100662025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100672025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
100682025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100692025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
100702025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100712025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
100722025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
100732025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100742025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100752025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100762025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
100772025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.343019ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
100782025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100792025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100802025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
100812025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.562243ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
100822025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100832025-03-25T01:28:31.740ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
100842025-03-25T01:28:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
100852025-03-25T01:28:31.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100862025-03-25T01:28:31.742ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100872025-03-25T01:28:31.743ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.761514ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100882025-03-25T01:28:31.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
100892025-03-25T01:28:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
100902025-03-25T01:28:31.744ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:18:31.739460169 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
100912025-03-25T01:28:31.744ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.796708ms iteration = 10 status = {"expiration":"2025-03-25T01:18:31.739460169Z","pruned":[]}
100922025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
100932025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
100942025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
100952025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100962025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100972025-03-25T01:28:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100982025-03-25T01:28:31.746ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100992025-03-25T01:28:31.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101002025-03-25T01:28:31.751ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 462953172 } })
101012025-03-25T01:28:31.751ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
101022025-03-25T01:28:31.752ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 464353002 } })
101032025-03-25T01:28:31.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101042025-03-25T01:28:31.753ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
101052025-03-25T01:28:31.753ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101062025-03-25T01:28:31.753ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101072025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101082025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101092025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101102025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101112025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101122025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101132025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101142025-03-25T01:28:31.756ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101152025-03-25T01:28:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101162025-03-25T01:28:31.758ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
101172025-03-25T01:28:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
101182025-03-25T01:28:31.758ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101192025-03-25T01:28:31.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101202025-03-25T01:28:31.760ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.624235ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
101212025-03-25T01:28:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101222025-03-25T01:28:31.760ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101232025-03-25T01:28:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101242025-03-25T01:28:31.761ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101252025-03-25T01:28:31.761ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101262025-03-25T01:28:31.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101272025-03-25T01:28:31.767ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101282025-03-25T01:28:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101292025-03-25T01:28:31.774ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101302025-03-25T01:28:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101312025-03-25T01:28:31.777ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
101322025-03-25T01:28:31.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
101332025-03-25T01:28:31.782ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1415, tv_nsec: 493857024 } })
101342025-03-25T01:28:31.782ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
101352025-03-25T01:28:31.820ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101362025-03-25T01:28:31.822ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 82.362998ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
101372025-03-25T01:28:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
101382025-03-25T01:28:31.824ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
101392025-03-25T01:28:31.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
101402025-03-25T01:28:31.825ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101412025-03-25T01:28:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101422025-03-25T01:28:31.826ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101432025-03-25T01:28:31.829ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101442025-03-25T01:28:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101452025-03-25T01:28:31.830ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 90.581896ms iteration = 19 status = {"errors":[],"finish_invoked_ok":[]}
101462025-03-25T01:28:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101472025-03-25T01:28:31.830ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101482025-03-25T01:28:31.830ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101492025-03-25T01:28:31.832ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101502025-03-25T01:28:31.832ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101512025-03-25T01:28:31.833ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101522025-03-25T01:28:31.833ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101532025-03-25T01:28:31.834ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101542025-03-25T01:28:31.834ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101552025-03-25T01:28:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101562025-03-25T01:28:31.836ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101572025-03-25T01:28:31.836ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101582025-03-25T01:28:31.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101592025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101602025-03-25T01:28:31.837ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101612025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101622025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101632025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101642025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101652025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
101662025-03-25T01:28:31.837ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
101672025-03-25T01:28:31.837ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 98.045803ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
101682025-03-25T01:28:31.838ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
101692025-03-25T01:28:31.839ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101702025-03-25T01:28:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101712025-03-25T01:28:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101722025-03-25T01:28:31.840ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101732025-03-25T01:28:31.840ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101742025-03-25T01:28:31.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101752025-03-25T01:28:31.841ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101762025-03-25T01:28:31.843ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101772025-03-25T01:28:31.844ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101782025-03-25T01:28:31.844ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 104.414844ms iteration = 19 status = {"errors":[],"requests_created_ok":[]}
101792025-03-25T01:28:31.844ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
101802025-03-25T01:28:31.845ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101812025-03-25T01:28:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101822025-03-25T01:28:31.845ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101832025-03-25T01:28:31.845ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101842025-03-25T01:28:31.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101852025-03-25T01:28:31.846ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101862025-03-25T01:28:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
101872025-03-25T01:28:31.847ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
101882025-03-25T01:28:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
101892025-03-25T01:28:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
101902025-03-25T01:28:31.849ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101912025-03-25T01:28:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
101922025-03-25T01:28:31.849ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
101932025-03-25T01:28:31.849ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
101942025-03-25T01:28:31.850ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101952025-03-25T01:28:31.863ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 121.139684ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101962025-03-25T01:28:31.867ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 127.979962ms iteration = 5 status = {"nsuccess":5}
101972025-03-25T01:28:31.884ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
101982025-03-25T01:28:31.898ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
101992025-03-25T01:28:31.899ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
102002025-03-25T01:28:31.899ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 159.409671ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
102012025-03-25T01:28:31.899ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 159.767147ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
102022025-03-25T01:28:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
102032025-03-25T01:28:31.901ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102042025-03-25T01:28:31.903ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
102052025-03-25T01:28:31.903ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
102062025-03-25T01:28:31.903ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 164.491464ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
102072025-03-25T01:28:31.904ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
102082025-03-25T01:28:31.904ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
102092025-03-25T01:28:31.904ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
102102025-03-25T01:28:31.904ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102112025-03-25T01:28:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
102122025-03-25T01:28:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102132025-03-25T01:28:31.905ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
102142025-03-25T01:28:31.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
102152025-03-25T01:28:31.907ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102162025-03-25T01:28:31.907ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
102172025-03-25T01:28:31.907ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 168.020344ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
102182025-03-25T01:28:31.910ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102192025-03-25T01:28:31.910ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102202025-03-25T01:28:31.911ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102212025-03-25T01:28:31.911ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102222025-03-25T01:28:31.911ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102232025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102242025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
102252025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
102262025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
102272025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102282025-03-25T01:28:31.912ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102292025-03-25T01:28:31.913ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102302025-03-25T01:28:31.913ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102312025-03-25T01:28:31.913ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 173.96966ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102322025-03-25T01:28:31.914ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 174.615748ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
102332025-03-25T01:28:31.914ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102342025-03-25T01:28:31.914ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102352025-03-25T01:28:31.915ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
102362025-03-25T01:28:31.915ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102372025-03-25T01:28:31.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102382025-03-25T01:28:31.918ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
102392025-03-25T01:28:31.918ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
102402025-03-25T01:28:31.918ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
102412025-03-25T01:28:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102422025-03-25T01:28:31.919ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102432025-03-25T01:28:31.919ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102442025-03-25T01:28:31.922ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 182.622613ms iteration = 19 status = 0
102452025-03-25T01:28:31.926ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102462025-03-25T01:28:31.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102472025-03-25T01:28:31.928ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102482025-03-25T01:28:31.928ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
102492025-03-25T01:28:31.928ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
102502025-03-25T01:28:31.928ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102512025-03-25T01:28:31.928ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
102522025-03-25T01:28:31.931ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
102532025-03-25T01:28:31.931ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
102542025-03-25T01:28:31.931ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
102552025-03-25T01:28:31.952ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102562025-03-25T01:28:31.953ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102572025-03-25T01:28:31.962ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
102582025-03-25T01:28:31.962ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
102592025-03-25T01:28:31.963ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3de21f55-7a64-4cb9-a8a3-06fc3c3fa149", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:31 GMT"} })
102602025-03-25T01:28:31.963ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
102612025-03-25T01:28:31.965ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
102622025-03-25T01:28:31.971ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102632025-03-25T01:28:31.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102642025-03-25T01:28:31.973ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102652025-03-25T01:28:31.974ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
102662025-03-25T01:28:31.974ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
102672025-03-25T01:28:31.974ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102682025-03-25T01:28:31.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102692025-03-25T01:28:31.975ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
102702025-03-25T01:28:31.975ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
102712025-03-25T01:28:31.975ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
102722025-03-25T01:28:31.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102732025-03-25T01:28:31.976ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
102742025-03-25T01:28:31.976ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
102752025-03-25T01:28:31.976ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102762025-03-25T01:28:31.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102772025-03-25T01:28:31.978ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
102782025-03-25T01:28:31.978ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
102792025-03-25T01:28:31.978ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 238.458172ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
102802025-03-25T01:28:31.978ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102812025-03-25T01:28:31.980ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
102822025-03-25T01:28:31.980ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
102832025-03-25T01:28:31.980ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
102842025-03-25T01:28:31.981ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
102852025-03-25T01:28:31.981ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
102862025-03-25T01:28:31.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
102872025-03-25T01:28:31.982ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
102882025-03-25T01:28:31.982ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
102892025-03-25T01:28:31.982ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
102902025-03-25T01:28:31.982ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 243.16776ms iteration = 10 status = {"generation":1}
102912025-03-25T01:28:31.983ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
102922025-03-25T01:28:31.983ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
102932025-03-25T01:28:31.983ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
102942025-03-25T01:28:31.983ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 244.042312ms iteration = 10 status = {"generation":2}
102952025-03-25T01:28:31.992ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
102962025-03-25T01:28:31.992ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 252.688266ms iteration = 19 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
102972025-03-25T01:28:32.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102982025-03-25T01:28:32.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102992025-03-25T01:28:32.017ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103002025-03-25T01:28:32.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103012025-03-25T01:28:32.019ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103022025-03-25T01:28:32.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103032025-03-25T01:28:32.021ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103042025-03-25T01:28:32.024ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
103052025-03-25T01:28:32.024ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103062025-03-25T01:28:32.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103072025-03-25T01:28:32.034ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
103082025-03-25T01:28:32.034ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 295.210554ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
103092025-03-25T01:28:32.036ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
103102025-03-25T01:28:32.036ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 296.829878ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
103112025-03-25T01:28:32.048ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 308.911041ms iteration = 21 status = {"physical_disks_added":0}
103122025-03-25T01:28:32.058ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
103132025-03-25T01:28:32.076ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
103142025-03-25T01:28:32.077ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8baf183b-ebc4-4c12-a57e-7ff63fa5b644", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103152025-03-25T01:28:32.077ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103162025-03-25T01:28:32.079ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "6cfc4385-2042-490e-af66-fca9aa1e7d94", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103172025-03-25T01:28:32.079ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103182025-03-25T01:28:32.082ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
103192025-03-25T01:28:32.082ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 342.948138ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
103202025-03-25T01:28:32.136ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
103212025-03-25T01:28:32.136ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103222025-03-25T01:28:32.137ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "393176c4-bc0c-4609-b3bd-a99d4446faaa", "content-length": "372", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103232025-03-25T01:28:32.137ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103242025-03-25T01:28:32.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103252025-03-25T01:28:32.139ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
103262025-03-25T01:28:32.139ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103272025-03-25T01:28:32.140ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e1e831b-b679-4dec-aa31-3da47252208c", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:31 GMT"} })
103282025-03-25T01:28:32.140ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103292025-03-25T01:28:32.142ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103302025-03-25T01:28:32.165ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
103312025-03-25T01:28:32.165ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
103322025-03-25T01:28:32.165ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "60dbd22b-073b-4289-a157-270a8c900698", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103332025-03-25T01:28:32.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103342025-03-25T01:28:32.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103352025-03-25T01:28:32.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103362025-03-25T01:28:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103372025-03-25T01:28:32.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103382025-03-25T01:28:32.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103392025-03-25T01:28:32.177ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
103402025-03-25T01:28:32.177ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
103412025-03-25T01:28:32.177ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06349ba5-0020-447a-bc07-27fda218757c", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103422025-03-25T01:28:32.179ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 439.871384ms iteration = 19 status = {}
103432025-03-25T01:28:32.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
103442025-03-25T01:28:32.204ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
103452025-03-25T01:28:32.204ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "02a261f5-78a7-4371-8e36-c7564370dc0e", "content-length": "26", "date": "Tue, 25 Mar 2025 01:28:31 GMT"} })
103462025-03-25T01:28:32.204ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
103472025-03-25T01:28:32.206ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
103482025-03-25T01:28:32.241ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 692edd34-b867-4e8d-a5eb-c1ac395c559e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
103492025-03-25T01:28:32.241ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 692edd34-b867-4e8d-a5eb-c1ac395c559e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
103502025-03-25T01:28:32.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
103512025-03-25T01:28:32.285ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
103522025-03-25T01:28:32.285ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d84f39e-da3f-4c74-a6f9-c61c13de1239", "content-length": "1", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103532025-03-25T01:28:32.287ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103542025-03-25T01:28:32.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103552025-03-25T01:28:32.289ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
103562025-03-25T01:28:32.289ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "aac8ba50-0b47-40e9-a37e-a8773bfc5f5e", "content-length": "691", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103572025-03-25T01:28:32.289ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
103582025-03-25T01:28:32.289ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
103592025-03-25T01:28:32.289ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
103602025-03-25T01:28:32.291ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 551.621613ms iteration = 19 status = {}
103612025-03-25T01:28:32.291ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 50696 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 692edd34-b867-4e8d-a5eb-c1ac395c559e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
103622025-03-25T01:28:32.292ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 552.424864ms iteration = 19 status = null
103632025-03-25T01:28:32.330ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 590.581901ms iteration = 19 status = {}
103642025-03-25T01:28:32.345ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
103652025-03-25T01:28:32.346ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fd20d634-715c-4608-96f2-7fcb68fae99b", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103662025-03-25T01:28:32.346ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103672025-03-25T01:28:32.348ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9878b9a0-c4b9-470a-84e1-5e8aa1dd558f", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103682025-03-25T01:28:32.348ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103692025-03-25T01:28:32.349ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "882479ee-32cc-4456-80d7-68f02452d6ca", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103702025-03-25T01:28:32.349ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103712025-03-25T01:28:32.351ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
103722025-03-25T01:28:32.351ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 612.378132ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
103732025-03-25T01:28:32.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103742025-03-25T01:28:32.359ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103752025-03-25T01:28:32.361ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
103762025-03-25T01:28:32.361ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103772025-03-25T01:28:32.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103782025-03-25T01:28:32.370ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
103792025-03-25T01:28:32.370ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1906b0f-39e2-4923-8fef-dc8c4da2a6ad", "content-length": "134", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103802025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
103812025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
103822025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
103832025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
103842025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103852025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103862025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103872025-03-25T01:28:32.370ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103882025-03-25T01:28:32.371ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
103892025-03-25T01:28:32.371ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
103902025-03-25T01:28:32.371ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
103912025-03-25T01:28:32.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103922025-03-25T01:28:32.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103932025-03-25T01:28:32.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
103942025-03-25T01:28:32.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "31b1ea38-31f7-47c5-8328-54636dc6215d", "content-length": "2", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103952025-03-25T01:28:32.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
103962025-03-25T01:28:32.373ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca45b513-6373-4dba-8cdf-224c11899e44", "content-length": "51", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
103972025-03-25T01:28:32.373ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
103982025-03-25T01:28:32.373ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
103992025-03-25T01:28:32.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8747f987-00d3-49e3-a46a-0c99ca91c12b", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
104002025-03-25T01:28:32.473ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
104012025-03-25T01:28:32.473ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
104022025-03-25T01:28:32.473ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "94f41c94-54f0-44e3-8e77-96c3e2ecd2ab", "content-length": "682", "date": "Tue, 25 Mar 2025 01:28:32 GMT"} })
104032025-03-25T01:28:32.473ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104042025-03-25T01:28:32.474ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104052025-03-25T01:28:32.477ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104062025-03-25T01:28:32.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104072025-03-25T01:28:32.481ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104082025-03-25T01:28:32.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104092025-03-25T01:28:32.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104102025-03-25T01:28:32.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104112025-03-25T01:28:32.491ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 751.877589ms iteration = 19 status = {}
104122025-03-25T01:28:33.312ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dadb76bb-d48f-4da3-9eab-36971b953011 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104132025-03-25T01:28:33.312ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dadb76bb-d48f-4da3-9eab-36971b953011 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104142025-03-25T01:28:33.314ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2051 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dadb76bb-d48f-4da3-9eab-36971b953011 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104152025-03-25T01:28:34.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 37e1b9f1-32f4-4042-bca5-c7ced2a2de9b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104162025-03-25T01:28:34.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 37e1b9f1-32f4-4042-bca5-c7ced2a2de9b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104172025-03-25T01:28:34.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2273 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 37e1b9f1-32f4-4042-bca5-c7ced2a2de9b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104182025-03-25T01:28:35.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b3c2b1d-a70c-40e0-b785-4e58cff077e0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104192025-03-25T01:28:35.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b3c2b1d-a70c-40e0-b785-4e58cff077e0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104202025-03-25T01:28:35.359ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1997 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0b3c2b1d-a70c-40e0-b785-4e58cff077e0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104212025-03-25T01:28:35.766ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 562 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 35c215df-6def-4502-8265-817c61b5c86e response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
104222025-03-25T01:28:36.378ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d0db0e-bfa6-4683-b025-bb36c9b2b59c roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104232025-03-25T01:28:36.379ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d0db0e-bfa6-4683-b025-bb36c9b2b59c resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104242025-03-25T01:28:36.380ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2182 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d0db0e-bfa6-4683-b025-bb36c9b2b59c response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104252025-03-25T01:28:37.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 371bebb7-dbd9-483b-8e9d-2e66f17c4b61 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104262025-03-25T01:28:37.401ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 371bebb7-dbd9-483b-8e9d-2e66f17c4b61 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104272025-03-25T01:28:37.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1606 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 371bebb7-dbd9-483b-8e9d-2e66f17c4b61 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104282025-03-25T01:28:38.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 59d69e9d-d5e7-4c10-99b1-6a737fbf8c12 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104292025-03-25T01:28:38.424ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 59d69e9d-d5e7-4c10-99b1-6a737fbf8c12 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104302025-03-25T01:28:38.426ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2515 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 59d69e9d-d5e7-4c10-99b1-6a737fbf8c12 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104312025-03-25T01:28:39.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b52b38d-6175-4952-8709-a8d4655f03e8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104322025-03-25T01:28:39.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b52b38d-6175-4952-8709-a8d4655f03e8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104332025-03-25T01:28:39.449ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2094 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1b52b38d-6175-4952-8709-a8d4655f03e8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104342025-03-25T01:28:40.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c0fd492a-bf3c-47be-89a3-24726ece6992 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104352025-03-25T01:28:40.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c0fd492a-bf3c-47be-89a3-24726ece6992 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104362025-03-25T01:28:40.472ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2400 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c0fd492a-bf3c-47be-89a3-24726ece6992 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104372025-03-25T01:28:41.493ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7669f02-6a2e-4d2a-a368-734bffac5435 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104382025-03-25T01:28:41.493ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7669f02-6a2e-4d2a-a368-734bffac5435 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104392025-03-25T01:28:41.495ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2064 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7669f02-6a2e-4d2a-a368-734bffac5435 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104402025-03-25T01:28:41.738ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
104412025-03-25T01:28:41.738ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104422025-03-25T01:28:41.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104432025-03-25T01:28:41.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
104442025-03-25T01:28:41.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104452025-03-25T01:28:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104462025-03-25T01:28:41.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104472025-03-25T01:28:41.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104482025-03-25T01:28:41.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104492025-03-25T01:28:41.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104502025-03-25T01:28:41.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104512025-03-25T01:28:41.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104522025-03-25T01:28:41.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.119688ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104532025-03-25T01:28:41.745ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104542025-03-25T01:28:41.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104552025-03-25T01:28:41.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104562025-03-25T01:28:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
104572025-03-25T01:28:41.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104582025-03-25T01:28:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104592025-03-25T01:28:41.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
104602025-03-25T01:28:41.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.828951ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
104612025-03-25T01:28:42.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e26d312-9940-4a5a-b6af-9d4f83f0fbb6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104622025-03-25T01:28:42.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e26d312-9940-4a5a-b6af-9d4f83f0fbb6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104632025-03-25T01:28:42.518ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8e26d312-9940-4a5a-b6af-9d4f83f0fbb6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104642025-03-25T01:28:43.539ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 507c0f8c-1449-483c-a97c-b12d364f2852 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104652025-03-25T01:28:43.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 507c0f8c-1449-483c-a97c-b12d364f2852 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104662025-03-25T01:28:43.541ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 507c0f8c-1449-483c-a97c-b12d364f2852 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104672025-03-25T01:28:44.562ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d1e8fa-0465-425d-b27b-9458fd35fd2f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104682025-03-25T01:28:44.562ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d1e8fa-0465-425d-b27b-9458fd35fd2f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104692025-03-25T01:28:44.564ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2455 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 87d1e8fa-0465-425d-b27b-9458fd35fd2f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104702025-03-25T01:28:45.584ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b53c7a0-92ea-49e1-8a45-3661670a24d3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104712025-03-25T01:28:45.584ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b53c7a0-92ea-49e1-8a45-3661670a24d3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104722025-03-25T01:28:45.586ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4b53c7a0-92ea-49e1-8a45-3661670a24d3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104732025-03-25T01:28:45.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = d8edaf82-5189-4cb0-88b9-66dc4e313a77 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
104742025-03-25T01:28:45.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = d8edaf82-5189-4cb0-88b9-66dc4e313a77 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
104752025-03-25T01:28:45.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2964 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = d8edaf82-5189-4cb0-88b9-66dc4e313a77 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
104762025-03-25T01:28:45.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 917760f5-cb1f-4aae-8e09-8d5fd120f14c roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
104772025-03-25T01:28:45.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 917760f5-cb1f-4aae-8e09-8d5fd120f14c resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
104782025-03-25T01:28:45.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2177 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = 917760f5-cb1f-4aae-8e09-8d5fd120f14c response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
104792025-03-25T01:28:45.765ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 418 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = addf2437-000a-4fa5-9a5f-78341a0ed7a6 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
104802025-03-25T01:28:46.606ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b8e492ea-58ff-4194-8f8d-3e7864dac650 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104812025-03-25T01:28:46.607ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b8e492ea-58ff-4194-8f8d-3e7864dac650 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104822025-03-25T01:28:46.609ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2106 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b8e492ea-58ff-4194-8f8d-3e7864dac650 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104832025-03-25T01:28:47.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 96089e78-7b6a-42bb-84a1-9c33a00c0f9f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104842025-03-25T01:28:47.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 96089e78-7b6a-42bb-84a1-9c33a00c0f9f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104852025-03-25T01:28:47.633ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2231 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 96089e78-7b6a-42bb-84a1-9c33a00c0f9f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104862025-03-25T01:28:48.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7f62306-665b-4154-9da1-355b377b7cf8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104872025-03-25T01:28:48.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7f62306-665b-4154-9da1-355b377b7cf8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104882025-03-25T01:28:48.654ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1882 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d7f62306-665b-4154-9da1-355b377b7cf8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104892025-03-25T01:28:49.675ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a7b69edd-3226-4dc6-9acc-7504ce66e712 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104902025-03-25T01:28:49.676ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a7b69edd-3226-4dc6-9acc-7504ce66e712 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104912025-03-25T01:28:49.677ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1931 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a7b69edd-3226-4dc6-9acc-7504ce66e712 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104922025-03-25T01:28:50.698ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e43b6c5d-9f3e-4906-ae21-5c47c03b5bd8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104932025-03-25T01:28:50.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e43b6c5d-9f3e-4906-ae21-5c47c03b5bd8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104942025-03-25T01:28:50.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2332 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e43b6c5d-9f3e-4906-ae21-5c47c03b5bd8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104952025-03-25T01:28:51.720ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2539d5ba-c640-4819-b134-04ca779668d5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104962025-03-25T01:28:51.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2539d5ba-c640-4819-b134-04ca779668d5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104972025-03-25T01:28:51.722ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2101 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2539d5ba-c640-4819-b134-04ca779668d5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
104982025-03-25T01:28:51.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
104992025-03-25T01:28:51.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105002025-03-25T01:28:51.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105012025-03-25T01:28:51.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
105022025-03-25T01:28:51.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105032025-03-25T01:28:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105042025-03-25T01:28:51.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105052025-03-25T01:28:51.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105062025-03-25T01:28:51.742ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
105072025-03-25T01:28:51.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
105082025-03-25T01:28:51.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105092025-03-25T01:28:51.743ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.796265ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105102025-03-25T01:28:51.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105112025-03-25T01:28:51.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105122025-03-25T01:28:51.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105132025-03-25T01:28:51.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105142025-03-25T01:28:51.748ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
105152025-03-25T01:28:51.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105162025-03-25T01:28:51.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105172025-03-25T01:28:51.755ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
105182025-03-25T01:28:51.755ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 16.861222ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
105192025-03-25T01:28:52.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dd41cd79-f35c-41dc-b1b7-584f58c301a8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105202025-03-25T01:28:52.745ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dd41cd79-f35c-41dc-b1b7-584f58c301a8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105212025-03-25T01:28:52.746ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1954 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = dd41cd79-f35c-41dc-b1b7-584f58c301a8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105222025-03-25T01:28:53.767ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7218ecfb-8d85-4769-8e06-35bff3ca7f81 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105232025-03-25T01:28:53.767ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7218ecfb-8d85-4769-8e06-35bff3ca7f81 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105242025-03-25T01:28:53.769ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2002 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7218ecfb-8d85-4769-8e06-35bff3ca7f81 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105252025-03-25T01:28:54.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaf2e88e-632e-46be-9db8-34c5502f558f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105262025-03-25T01:28:54.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaf2e88e-632e-46be-9db8-34c5502f558f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105272025-03-25T01:28:54.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2445 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaf2e88e-632e-46be-9db8-34c5502f558f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105282025-03-25T01:28:55.766ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 525 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = b296fe61-8bc2-494b-9a43-d6156e1ea008 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
105292025-03-25T01:28:55.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a82488e-aaba-4aad-a0a9-b3ede99cd5ef roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105302025-03-25T01:28:55.812ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a82488e-aaba-4aad-a0a9-b3ede99cd5ef resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105312025-03-25T01:28:55.814ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2694 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9a82488e-aaba-4aad-a0a9-b3ede99cd5ef response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105322025-03-25T01:28:56.834ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 564f14bd-5a38-46a3-9b2c-4576bcdbf51a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105332025-03-25T01:28:56.835ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 564f14bd-5a38-46a3-9b2c-4576bcdbf51a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105342025-03-25T01:28:56.837ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2362 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 564f14bd-5a38-46a3-9b2c-4576bcdbf51a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105352025-03-25T01:28:57.857ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e72f7231-d587-4535-8a2e-fae8c20fdc46 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105362025-03-25T01:28:57.857ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e72f7231-d587-4535-8a2e-fae8c20fdc46 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105372025-03-25T01:28:57.859ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2044 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e72f7231-d587-4535-8a2e-fae8c20fdc46 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105382025-03-25T01:28:58.879ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9ba7330-b4e9-4ad8-b367-a6e0df36c25d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105392025-03-25T01:28:58.879ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9ba7330-b4e9-4ad8-b367-a6e0df36c25d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105402025-03-25T01:28:58.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1900 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = b9ba7330-b4e9-4ad8-b367-a6e0df36c25d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105412025-03-25T01:28:59.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 614c7334-91ad-4e20-9051-4537012a95c0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105422025-03-25T01:28:59.902ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 614c7334-91ad-4e20-9051-4537012a95c0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105432025-03-25T01:28:59.904ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2747 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 614c7334-91ad-4e20-9051-4537012a95c0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105442025-03-25T01:29:00.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = bbaeaf70-9bcd-4a12-a928-f6654ada9369 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
105452025-03-25T01:29:00.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = bbaeaf70-9bcd-4a12-a928-f6654ada9369 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
105462025-03-25T01:29:00.762ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3537 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = bbaeaf70-9bcd-4a12-a928-f6654ada9369 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
105472025-03-25T01:29:00.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = b0f94b91-8540-4fbd-b9af-b67b8dbffbe6 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
105482025-03-25T01:29:00.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = b0f94b91-8540-4fbd-b9af-b67b8dbffbe6 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
105492025-03-25T01:29:00.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2374 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:32845 req_id = b0f94b91-8540-4fbd-b9af-b67b8dbffbe6 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
105502025-03-25T01:29:00.927ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fca2b818-f173-4a63-8ca6-914934650d03 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105512025-03-25T01:29:00.927ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fca2b818-f173-4a63-8ca6-914934650d03 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105522025-03-25T01:29:00.929ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2007 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fca2b818-f173-4a63-8ca6-914934650d03 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
105532025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
105542025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
105552025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105562025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
105572025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
105582025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105592025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
105602025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105612025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
105622025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
105632025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
105642025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
105652025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105662025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105672025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105682025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
105692025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 20 reason = Timeout
105702025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
105712025-03-25T01:29:01.739ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
105722025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105732025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105742025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105752025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105762025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
105772025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
105782025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105792025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105802025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
105812025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
105822025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
105832025-03-25T01:29:01.740ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
105842025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
105852025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105862025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 20 reason = Timeout
105872025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
105882025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
105892025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105902025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
105912025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105922025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
105932025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
105942025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
105952025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
105962025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
105972025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
105982025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
105992025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
106002025-03-25T01:29:01.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106012025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
106022025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106032025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
106042025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106052025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106062025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
106072025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106082025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106092025-03-25T01:29:01.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106102025-03-25T01:29:01.742ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106112025-03-25T01:29:01.743ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106122025-03-25T01:29:01.743ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.16732ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
106132025-03-25T01:29:01.744ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106142025-03-25T01:29:01.744ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 455571436 } })
106152025-03-25T01:29:01.744ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
106162025-03-25T01:29:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
106172025-03-25T01:29:01.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106182025-03-25T01:29:01.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106192025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
106202025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106212025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106222025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
106232025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106242025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106252025-03-25T01:29:01.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106262025-03-25T01:29:01.747ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106272025-03-25T01:29:01.748ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 460028920 } })
106282025-03-25T01:29:01.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
106292025-03-25T01:29:01.749ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106302025-03-25T01:29:01.749ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106312025-03-25T01:29:01.749ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106322025-03-25T01:29:01.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106332025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
106342025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106352025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
106362025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
106372025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106382025-03-25T01:29:01.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
106392025-03-25T01:29:01.753ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 12.612351ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
106402025-03-25T01:29:01.758ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106412025-03-25T01:29:01.760ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106422025-03-25T01:29:01.760ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106432025-03-25T01:29:01.760ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1445, tv_nsec: 472092433 } })
106442025-03-25T01:29:01.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106452025-03-25T01:29:01.761ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
106462025-03-25T01:29:01.761ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106472025-03-25T01:29:01.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106482025-03-25T01:29:01.762ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106492025-03-25T01:29:01.762ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
106502025-03-25T01:29:01.762ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106512025-03-25T01:29:01.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106522025-03-25T01:29:01.763ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106532025-03-25T01:29:01.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106542025-03-25T01:29:01.769ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
106552025-03-25T01:29:01.769ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 28.282445ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
106562025-03-25T01:29:01.769ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106572025-03-25T01:29:01.769ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106582025-03-25T01:29:01.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106592025-03-25T01:29:01.774ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106602025-03-25T01:29:01.777ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
106612025-03-25T01:29:01.777ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106622025-03-25T01:29:01.777ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106632025-03-25T01:29:01.778ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
106642025-03-25T01:29:01.778ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
106652025-03-25T01:29:01.778ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
106662025-03-25T01:29:01.798ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
106672025-03-25T01:29:01.799ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106682025-03-25T01:29:01.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
106692025-03-25T01:29:01.799ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106702025-03-25T01:29:01.800ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
106712025-03-25T01:29:01.800ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 61.356798ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
106722025-03-25T01:29:01.804ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106732025-03-25T01:29:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106742025-03-25T01:29:01.804ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
106752025-03-25T01:29:01.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
106762025-03-25T01:29:01.806ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 67.014819ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106772025-03-25T01:29:01.810ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106782025-03-25T01:29:01.814ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
106792025-03-25T01:29:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
106802025-03-25T01:29:01.814ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106812025-03-25T01:29:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
106822025-03-25T01:29:01.814ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106832025-03-25T01:29:01.817ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.704762ms iteration = 20 status = 0
106842025-03-25T01:29:01.819ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 78.883139ms iteration = 20 status = {"errors":[],"finish_invoked_ok":[]}
106852025-03-25T01:29:01.820ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 80.153287ms iteration = 20 status = {"errors":[],"requests_created_ok":[]}
106862025-03-25T01:29:01.823ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
106872025-03-25T01:29:01.823ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
106882025-03-25T01:29:01.823ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
106892025-03-25T01:29:01.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
106902025-03-25T01:29:01.824ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
106912025-03-25T01:29:01.824ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
106922025-03-25T01:29:01.825ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106932025-03-25T01:29:01.827ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
106942025-03-25T01:29:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
106952025-03-25T01:29:01.828ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
106962025-03-25T01:29:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
106972025-03-25T01:29:01.828ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
106982025-03-25T01:29:01.829ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106992025-03-25T01:29:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
107002025-03-25T01:29:01.831ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
107012025-03-25T01:29:01.831ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
107022025-03-25T01:29:01.835ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
107032025-03-25T01:29:01.835ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 93.68332ms iteration = 20 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
107042025-03-25T01:29:01.840ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107052025-03-25T01:29:01.840ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107062025-03-25T01:29:01.851ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
107072025-03-25T01:29:01.852ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
107082025-03-25T01:29:01.856ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 115.854108ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107092025-03-25T01:29:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 119.781894ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
107102025-03-25T01:29:01.860ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
107112025-03-25T01:29:01.860ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
107122025-03-25T01:29:01.860ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.803934ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
107132025-03-25T01:29:01.871ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
107142025-03-25T01:29:01.871ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107152025-03-25T01:29:01.871ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1df4cacc-b2be-4a0f-85a9-105e41bb378d", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107162025-03-25T01:29:01.871ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107172025-03-25T01:29:01.873ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107182025-03-25T01:29:01.874ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 134.830979ms iteration = 22 status = {"physical_disks_added":0}
107192025-03-25T01:29:01.881ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 141.102099ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
107202025-03-25T01:29:01.930ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
107212025-03-25T01:29:01.930ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107222025-03-25T01:29:01.930ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "32f139b6-1b52-45b3-8182-f250e678f05d", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107232025-03-25T01:29:01.931ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107242025-03-25T01:29:01.933ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
107252025-03-25T01:29:01.949ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eceb59a0-03e6-4f7b-8be5-c081b7414145 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
107262025-03-25T01:29:01.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eceb59a0-03e6-4f7b-8be5-c081b7414145 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
107272025-03-25T01:29:01.963ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107282025-03-25T01:29:01.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107292025-03-25T01:29:01.971ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
107302025-03-25T01:29:01.971ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
107312025-03-25T01:29:01.971ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "88adef95-5f27-4c8f-9a57-f5a7257fb36b", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107322025-03-25T01:29:01.971ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
107332025-03-25T01:29:01.973ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
107342025-03-25T01:29:01.989ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
107352025-03-25T01:29:01.989ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107362025-03-25T01:29:01.989ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
107372025-03-25T01:29:01.989ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ebc9012-1b12-4743-a1b5-c2e61933ecdf", "content-length": "372", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107382025-03-25T01:29:01.989ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107392025-03-25T01:29:01.989ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c969e21b-22c7-456b-9649-120c0abfb3a3", "content-length": "1", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107402025-03-25T01:29:01.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107412025-03-25T01:29:01.991ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107422025-03-25T01:29:01.991ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 41738 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eceb59a0-03e6-4f7b-8be5-c081b7414145 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
107432025-03-25T01:29:01.991ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
107442025-03-25T01:29:01.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
107452025-03-25T01:29:01.992ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.250893ms iteration = 20 status = null
107462025-03-25T01:29:01.993ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107472025-03-25T01:29:01.993ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107482025-03-25T01:29:01.993ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107492025-03-25T01:29:01.994ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107502025-03-25T01:29:01.996ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
107512025-03-25T01:29:01.996ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107522025-03-25T01:29:01.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
107532025-03-25T01:29:02.040ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 300.932356ms iteration = 20 status = {}
107542025-03-25T01:29:02.043ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
107552025-03-25T01:29:02.043ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
107562025-03-25T01:29:02.044ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0d03f5c8-f28c-4636-961f-b23e5608f95e", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107572025-03-25T01:29:02.044ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107582025-03-25T01:29:02.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107592025-03-25T01:29:02.050ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107602025-03-25T01:29:02.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107612025-03-25T01:29:02.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107622025-03-25T01:29:02.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
107632025-03-25T01:29:02.063ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
107642025-03-25T01:29:02.063ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
107652025-03-25T01:29:02.064ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bbb84b9e-5334-4b10-b65e-aef37ef994ef", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107662025-03-25T01:29:02.066ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 325.473688ms iteration = 20 status = {}
107672025-03-25T01:29:02.099ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
107682025-03-25T01:29:02.100ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "46cdb91c-d272-4336-b18e-8e1bdc8b308d", "content-length": "691", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107692025-03-25T01:29:02.100ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
107702025-03-25T01:29:02.100ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
107712025-03-25T01:29:02.100ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
107722025-03-25T01:29:02.101ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 362.300285ms iteration = 20 status = {}
107732025-03-25T01:29:02.152ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107742025-03-25T01:29:02.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107752025-03-25T01:29:02.155ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
107762025-03-25T01:29:02.155ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107772025-03-25T01:29:02.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107782025-03-25T01:29:02.163ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107792025-03-25T01:29:02.163ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1385c69-d854-4e87-92df-fdf291d7d53f", "content-length": "134", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107802025-03-25T01:29:02.163ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107812025-03-25T01:29:02.163ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
107822025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107832025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107842025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107852025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107862025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107872025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107882025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107892025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107902025-03-25T01:29:02.164ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
107912025-03-25T01:29:02.164ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107922025-03-25T01:29:02.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107932025-03-25T01:29:02.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107942025-03-25T01:29:02.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b02dcf7e-0f19-495d-be6a-cef1d13203f2", "content-length": "2", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107952025-03-25T01:29:02.167ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107962025-03-25T01:29:02.167ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "34495d43-2365-45ca-b445-9d7d93bc1f7a", "content-length": "51", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
107972025-03-25T01:29:02.167ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
107982025-03-25T01:29:02.167ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107992025-03-25T01:29:02.268ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "622154ab-bb59-4756-8a4a-ed7e72013231", "date": "Tue, 25 Mar 2025 01:29:01 GMT"} })
108002025-03-25T01:29:02.268ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
108012025-03-25T01:29:02.268ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
108022025-03-25T01:29:02.269ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "c112cb91-f6ab-4450-bc6b-e4586c02e83b", "content-length": "682", "date": "Tue, 25 Mar 2025 01:29:02 GMT"} })
108032025-03-25T01:29:02.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108042025-03-25T01:29:02.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108052025-03-25T01:29:02.274ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108062025-03-25T01:29:02.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108072025-03-25T01:29:02.277ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108082025-03-25T01:29:02.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108092025-03-25T01:29:02.280ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108102025-03-25T01:29:02.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108112025-03-25T01:29:02.288ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 548.61272ms iteration = 20 status = {}
108122025-03-25T01:29:03.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fbb1e84a-45cc-4ac8-9cb9-6c6b9a2cbd8e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108132025-03-25T01:29:03.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fbb1e84a-45cc-4ac8-9cb9-6c6b9a2cbd8e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108142025-03-25T01:29:03.016ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2153 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fbb1e84a-45cc-4ac8-9cb9-6c6b9a2cbd8e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108152025-03-25T01:29:04.035ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46513d26-1167-432a-898e-d49838010d45 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108162025-03-25T01:29:04.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46513d26-1167-432a-898e-d49838010d45 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108172025-03-25T01:29:04.037ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1858 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 46513d26-1167-432a-898e-d49838010d45 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108182025-03-25T01:29:05.059ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 515babf5-40ce-4f48-b23b-898db25699bc roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108192025-03-25T01:29:05.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 515babf5-40ce-4f48-b23b-898db25699bc resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108202025-03-25T01:29:05.068ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 8540 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 515babf5-40ce-4f48-b23b-898db25699bc response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108212025-03-25T01:29:05.766ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 536 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 1aadd261-f3c6-44ad-a94f-c8e39bf7ea5b response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
108222025-03-25T01:29:06.088ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7e2ad3b7-bd60-4c16-9792-42a50cc28d35 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108232025-03-25T01:29:06.089ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7e2ad3b7-bd60-4c16-9792-42a50cc28d35 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108242025-03-25T01:29:06.090ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1986 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 7e2ad3b7-bd60-4c16-9792-42a50cc28d35 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108252025-03-25T01:29:07.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6093414f-437e-4bf1-bdd4-413f0993918f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108262025-03-25T01:29:07.112ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6093414f-437e-4bf1-bdd4-413f0993918f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108272025-03-25T01:29:07.114ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 3019 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6093414f-437e-4bf1-bdd4-413f0993918f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108282025-03-25T01:29:08.138ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44394b55-1739-47e9-9106-8187b4bb8d4a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108292025-03-25T01:29:08.138ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44394b55-1739-47e9-9106-8187b4bb8d4a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108302025-03-25T01:29:08.140ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2512 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 44394b55-1739-47e9-9106-8187b4bb8d4a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108312025-03-25T01:29:09.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 397d4db4-0b27-4082-8981-5115a8b8837e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108322025-03-25T01:29:09.160ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 397d4db4-0b27-4082-8981-5115a8b8837e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108332025-03-25T01:29:09.162ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2057 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 397d4db4-0b27-4082-8981-5115a8b8837e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108342025-03-25T01:29:10.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaeec513-78fc-47b0-bd8d-1bd99a3acff6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108352025-03-25T01:29:10.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaeec513-78fc-47b0-bd8d-1bd99a3acff6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108362025-03-25T01:29:10.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2516 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eaeec513-78fc-47b0-bd8d-1bd99a3acff6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108372025-03-25T01:29:11.207ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 975f4cf4-f1e8-4fe0-8563-2160d16a2d7a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108382025-03-25T01:29:11.207ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 975f4cf4-f1e8-4fe0-8563-2160d16a2d7a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108392025-03-25T01:29:11.208ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2010 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 975f4cf4-f1e8-4fe0-8563-2160d16a2d7a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108402025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
108412025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108422025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108432025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
108442025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108452025-03-25T01:29:11.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108462025-03-25T01:29:11.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108472025-03-25T01:29:11.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108482025-03-25T01:29:11.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108492025-03-25T01:29:11.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.973147ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108502025-03-25T01:29:11.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108512025-03-25T01:29:11.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108522025-03-25T01:29:11.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108532025-03-25T01:29:11.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108542025-03-25T01:29:11.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108552025-03-25T01:29:11.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108562025-03-25T01:29:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
108572025-03-25T01:29:11.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108582025-03-25T01:29:11.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108592025-03-25T01:29:11.758ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
108602025-03-25T01:29:11.758ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.993128ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
108612025-03-25T01:29:12.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1676b551-8090-459a-af72-0545ab8e131e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108622025-03-25T01:29:12.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1676b551-8090-459a-af72-0545ab8e131e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108632025-03-25T01:29:12.230ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1970 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1676b551-8090-459a-af72-0545ab8e131e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108642025-03-25T01:29:13.250ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d80d73bb-60a8-4c9d-afb9-7128864b0966 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108652025-03-25T01:29:13.251ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d80d73bb-60a8-4c9d-afb9-7128864b0966 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108662025-03-25T01:29:13.252ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2102 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d80d73bb-60a8-4c9d-afb9-7128864b0966 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108672025-03-25T01:29:14.271ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1304fd2d-4819-4cb9-a68e-e94b5b9ac02a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108682025-03-25T01:29:14.272ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1304fd2d-4819-4cb9-a68e-e94b5b9ac02a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108692025-03-25T01:29:14.273ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2184 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1304fd2d-4819-4cb9-a68e-e94b5b9ac02a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108702025-03-25T01:29:15.295ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9af0f0e6-4757-48c0-be28-822afde2470b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108712025-03-25T01:29:15.295ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9af0f0e6-4757-48c0-be28-822afde2470b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108722025-03-25T01:29:15.297ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2304 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 9af0f0e6-4757-48c0-be28-822afde2470b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108732025-03-25T01:29:15.767ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 739 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = f2a738d9-cae6-4b77-81b8-8cb55fe59cec response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
108742025-03-25T01:29:16.317ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0580f0b6-0056-4ba5-923f-88251b894157 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108752025-03-25T01:29:16.317ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0580f0b6-0056-4ba5-923f-88251b894157 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108762025-03-25T01:29:16.319ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2338 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 0580f0b6-0056-4ba5-923f-88251b894157 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108772025-03-25T01:29:17.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2d20482d-9cfb-47db-aba3-5fdcbdff5fd6 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108782025-03-25T01:29:17.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2d20482d-9cfb-47db-aba3-5fdcbdff5fd6 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108792025-03-25T01:29:17.342ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2380 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2d20482d-9cfb-47db-aba3-5fdcbdff5fd6 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108802025-03-25T01:29:18.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d0600c5-137c-417f-b03d-8e91615fcc31 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108812025-03-25T01:29:18.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d0600c5-137c-417f-b03d-8e91615fcc31 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108822025-03-25T01:29:18.364ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2193 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 1d0600c5-137c-417f-b03d-8e91615fcc31 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108832025-03-25T01:29:19.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a051c79c-4a8a-462f-ae89-f44aa2c39351 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108842025-03-25T01:29:19.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a051c79c-4a8a-462f-ae89-f44aa2c39351 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108852025-03-25T01:29:19.386ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2279 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = a051c79c-4a8a-462f-ae89-f44aa2c39351 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108862025-03-25T01:29:20.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 88d8d509-3160-4a1f-b411-609f4f6efd70 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108872025-03-25T01:29:20.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 88d8d509-3160-4a1f-b411-609f4f6efd70 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108882025-03-25T01:29:20.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2223 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 88d8d509-3160-4a1f-b411-609f4f6efd70 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108892025-03-25T01:29:21.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f598a7b-0840-4cf6-b30e-61f846dc2f45 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108902025-03-25T01:29:21.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f598a7b-0840-4cf6-b30e-61f846dc2f45 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108912025-03-25T01:29:21.431ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1890 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 6f598a7b-0840-4cf6-b30e-61f846dc2f45 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
108922025-03-25T01:29:21.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
108932025-03-25T01:29:21.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108942025-03-25T01:29:21.739ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108952025-03-25T01:29:21.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108962025-03-25T01:29:21.741ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
108972025-03-25T01:29:21.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108982025-03-25T01:29:21.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108992025-03-25T01:29:21.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109002025-03-25T01:29:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
109012025-03-25T01:29:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
109022025-03-25T01:29:21.743ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109032025-03-25T01:29:21.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109042025-03-25T01:29:21.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.693813ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109052025-03-25T01:29:21.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109062025-03-25T01:29:21.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109072025-03-25T01:29:21.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109082025-03-25T01:29:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
109092025-03-25T01:29:21.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109102025-03-25T01:29:21.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109112025-03-25T01:29:21.757ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
109122025-03-25T01:29:21.757ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 17.535611ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
109132025-03-25T01:29:22.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eb1c7033-19b3-4166-b48b-eb20d6f1074a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109142025-03-25T01:29:22.453ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eb1c7033-19b3-4166-b48b-eb20d6f1074a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109152025-03-25T01:29:22.454ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = eb1c7033-19b3-4166-b48b-eb20d6f1074a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109162025-03-25T01:29:23.475ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb68a6f-37e5-4d7f-8b97-aec5e6c96b21 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109172025-03-25T01:29:23.476ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb68a6f-37e5-4d7f-8b97-aec5e6c96b21 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109182025-03-25T01:29:23.477ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1888 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ecb68a6f-37e5-4d7f-8b97-aec5e6c96b21 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109192025-03-25T01:29:24.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 13cf1bef-c2c8-4ac2-ad96-7b79e59b14e2 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109202025-03-25T01:29:24.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 13cf1bef-c2c8-4ac2-ad96-7b79e59b14e2 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109212025-03-25T01:29:24.499ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2061 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 13cf1bef-c2c8-4ac2-ad96-7b79e59b14e2 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109222025-03-25T01:29:25.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dcef8b4-970d-4108-8e5b-c68fd2148fd0 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109232025-03-25T01:29:25.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dcef8b4-970d-4108-8e5b-c68fd2148fd0 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109242025-03-25T01:29:25.522ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2719 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 3dcef8b4-970d-4108-8e5b-c68fd2148fd0 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109252025-03-25T01:29:25.767ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 493 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = f3b2cafb-12ee-42b6-8dae-a0d99d60d76b response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
109262025-03-25T01:29:26.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db6feaa1-2062-45a7-a578-3b8e1ac8aa4e roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109272025-03-25T01:29:26.544ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db6feaa1-2062-45a7-a578-3b8e1ac8aa4e resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109282025-03-25T01:29:26.546ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2040 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = db6feaa1-2062-45a7-a578-3b8e1ac8aa4e response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109292025-03-25T01:29:27.566ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660382ae-70b0-4bd9-9c30-8d90b1b1bc73 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109302025-03-25T01:29:27.566ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660382ae-70b0-4bd9-9c30-8d90b1b1bc73 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109312025-03-25T01:29:27.568ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2680 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660382ae-70b0-4bd9-9c30-8d90b1b1bc73 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109322025-03-25T01:29:28.589ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4e1337d4-684b-4b87-a796-2fc8beaf957d roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109332025-03-25T01:29:28.589ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4e1337d4-684b-4b87-a796-2fc8beaf957d resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109342025-03-25T01:29:28.591ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1753 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 4e1337d4-684b-4b87-a796-2fc8beaf957d response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109352025-03-25T01:29:29.612ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 111516c0-5f92-431b-b857-58177cd75d7a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109362025-03-25T01:29:29.613ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 111516c0-5f92-431b-b857-58177cd75d7a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109372025-03-25T01:29:29.614ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2386 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 111516c0-5f92-431b-b857-58177cd75d7a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109382025-03-25T01:29:30.636ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c49fd392-2ad3-465b-b0d2-5617ffd36ac7 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109392025-03-25T01:29:30.636ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c49fd392-2ad3-465b-b0d2-5617ffd36ac7 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109402025-03-25T01:29:30.638ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1874 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = c49fd392-2ad3-465b-b0d2-5617ffd36ac7 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109412025-03-25T01:29:31.659ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be8a0100-8c50-4081-9c90-d9328ca16fed roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109422025-03-25T01:29:31.660ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be8a0100-8c50-4081-9c90-d9328ca16fed resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109432025-03-25T01:29:31.661ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1996 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = be8a0100-8c50-4081-9c90-d9328ca16fed response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
109442025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
109452025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
109462025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109472025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109482025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
109492025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
109502025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
109512025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
109522025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
109532025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
109542025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
109552025-03-25T01:29:31.739ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
109562025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
109572025-03-25T01:29:31.740ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2025-03-25 01:19:31.739948324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
109582025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
109592025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
109602025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
109612025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
109622025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
109632025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
109642025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
109652025-03-25T01:29:31.740ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
109662025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
109672025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
109682025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
109692025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
109702025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
109712025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
109722025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
109732025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109742025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
109752025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = support_bundle_collector iteration = 21 reason = Timeout
109762025-03-25T01:29:31.740ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:82 reason = blueprint disabled target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b
109772025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
109782025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
109792025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.25\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b"}
109802025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 5 reason = Timeout
109812025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
109822025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
109832025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109842025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
109852025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109862025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
109872025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
109882025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109892025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109902025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
109912025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
109922025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
109932025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
109942025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = read_only_region_replacement_start iteration = 21 reason = Timeout
109952025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = read_only_region_replacement_start roles = RoleSet { roles: {} }
109962025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
109972025-03-25T01:29:31.740ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
109982025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
109992025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
110002025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
110012025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110022025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
110032025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = tuf_artifact_replication iteration = 3 reason = Timeout
110042025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110052025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
110062025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
110072025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
110082025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
110092025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
110102025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
110112025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
110122025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110132025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
110142025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
110152025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
110162025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
110172025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110182025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110192025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
110202025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
110212025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
110222025-03-25T01:29:31.740ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
110232025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110242025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110252025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
110262025-03-25T01:29:31.740ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
110272025-03-25T01:29:31.740ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110282025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110292025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110302025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
110312025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
110322025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
110332025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110342025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110352025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110362025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
110372025-03-25T01:29:31.740ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("4b6e96f6-cd23-4897-9bfb-96b629ccf872.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("658f8989-b24e-48cb-83e6-b3a3b15d47d4.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::9))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 451482748 } })
110382025-03-25T01:29:31.740ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("3f0307c3-79bb-4dd8-87b6-ae6655144209.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("40054b36-2618-459b-aad0-799de8938fb6.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("b6a22759-03b9-4dff-b9a0-d413b6908c97.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 451485838 } })
110392025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
110402025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110412025-03-25T01:29:31.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = read_only_region_replacement_start resource = Database result = Ok(())
110422025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
110432025-03-25T01:29:31.741ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
110442025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
110452025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
110462025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
110472025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
110482025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
110492025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
110502025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
110512025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
110522025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
110532025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
110542025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
110552025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } dns_group = external
110562025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.494972ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::8]:5353","[fd00:1122:3344:101::9]:5353"]}
110572025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
110582025-03-25T01:29:31.741ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.645754ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
110592025-03-25T01:29:31.742ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110602025-03-25T01:29:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
110612025-03-25T01:29:31.743ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 453814091 } })
110622025-03-25T01:29:31.743ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110632025-03-25T01:29:31.743ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1077
110642025-03-25T01:29:31.743ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110652025-03-25T01:29:31.743ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110662025-03-25T01:29:31.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
110672025-03-25T01:29:31.744ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.480934ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
110682025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
110692025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110702025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110712025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
110722025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110732025-03-25T01:29:31.745ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
110742025-03-25T01:29:31.747ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2025-03-25 01:19:31.739948324 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
110752025-03-25T01:29:31.747ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.425416ms iteration = 11 status = {"expiration":"2025-03-25T01:19:31.739948324Z","pruned":[]}
110762025-03-25T01:29:31.747ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110772025-03-25T01:29:31.748ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110782025-03-25T01:29:31.749ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 460218173 } })
110792025-03-25T01:29:31.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110802025-03-25T01:29:31.749ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1077
110812025-03-25T01:29:31.749ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
110822025-03-25T01:29:31.749ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110832025-03-25T01:29:31.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
110842025-03-25T01:29:31.751ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110852025-03-25T01:29:31.751ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
110862025-03-25T01:29:31.751ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
110872025-03-25T01:29:31.751ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
110882025-03-25T01:29:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110892025-03-25T01:29:31.753ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110902025-03-25T01:29:31.753ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110912025-03-25T01:29:31.753ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110922025-03-25T01:29:31.754ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110932025-03-25T01:29:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
110942025-03-25T01:29:31.755ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
110952025-03-25T01:29:31.755ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
110962025-03-25T01:29:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
110972025-03-25T01:29:31.756ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110982025-03-25T01:29:31.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
110992025-03-25T01:29:31.757ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
111002025-03-25T01:29:31.757ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111012025-03-25T01:29:31.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111022025-03-25T01:29:31.760ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111032025-03-25T01:29:31.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111042025-03-25T01:29:31.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111052025-03-25T01:29:31.762ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111062025-03-25T01:29:31.763ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 22.767966ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
111072025-03-25T01:29:31.766ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111082025-03-25T01:29:31.767ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111092025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111102025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111112025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
111122025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
111132025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111142025-03-25T01:29:31.770ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
111152025-03-25T01:29:31.771ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111162025-03-25T01:29:31.772ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 31.857186ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
111172025-03-25T01:29:31.774ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111182025-03-25T01:29:31.774ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111192025-03-25T01:29:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111202025-03-25T01:29:31.774ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111212025-03-25T01:29:31.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111222025-03-25T01:29:31.777ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111232025-03-25T01:29:31.778ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
111242025-03-25T01:29:31.778ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:167 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
111252025-03-25T01:29:31.778ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 37.593617ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
111262025-03-25T01:29:31.780ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 490872831 } })
111272025-03-25T01:29:31.780ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1077 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
111282025-03-25T01:29:31.782ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111292025-03-25T01:29:31.784ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
111302025-03-25T01:29:31.784ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
111312025-03-25T01:29:31.784ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
111322025-03-25T01:29:31.784ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111332025-03-25T01:29:31.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111342025-03-25T01:29:31.787ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111352025-03-25T01:29:31.787ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111362025-03-25T01:29:31.792ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111372025-03-25T01:29:31.792ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111382025-03-25T01:29:31.794ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111392025-03-25T01:29:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111402025-03-25T01:29:31.795ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111412025-03-25T01:29:31.795ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111422025-03-25T01:29:31.797ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
111432025-03-25T01:29:31.797ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111442025-03-25T01:29:31.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
111452025-03-25T01:29:31.800ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
111462025-03-25T01:29:31.801ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
111472025-03-25T01:29:31.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
111482025-03-25T01:29:31.803ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111492025-03-25T01:29:31.804ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(62d85891-6bcf-47fd-99f3-6240c711b229, 0), (1469a400-b88f-4d91-b4c3-6a7cd205b8d2, 0), (87d806d7-6486-48c2-9a46-fc8cd66e95f9, 0), (76fd242d-7bdf-4b4b-9ecd-c3e067117286, 0)] collection_id = 62d85891-6bcf-47fd-99f3-6240c711b229
111502025-03-25T01:29:31.804ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111512025-03-25T01:29:31.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111522025-03-25T01:29:31.806ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111532025-03-25T01:29:31.806ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111542025-03-25T01:29:31.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111552025-03-25T01:29:31.808ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 68.204236ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
111562025-03-25T01:29:31.810ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111572025-03-25T01:29:31.815ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111582025-03-25T01:29:31.815ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111592025-03-25T01:29:31.816ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111602025-03-25T01:29:31.818ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111612025-03-25T01:29:31.818ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111622025-03-25T01:29:31.818ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111632025-03-25T01:29:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
111642025-03-25T01:29:31.822ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111652025-03-25T01:29:31.822ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111662025-03-25T01:29:31.823ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111672025-03-25T01:29:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
111682025-03-25T01:29:31.826ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111692025-03-25T01:29:31.826ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111702025-03-25T01:29:31.835ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111712025-03-25T01:29:31.835ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111722025-03-25T01:29:31.836ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111732025-03-25T01:29:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
111742025-03-25T01:29:31.839ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111752025-03-25T01:29:31.839ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111762025-03-25T01:29:31.841ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111772025-03-25T01:29:31.842ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111782025-03-25T01:29:31.843ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111792025-03-25T01:29:31.844ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 104.238652ms iteration = 21 status = {"errors":[],"finish_invoked_ok":[]}
111802025-03-25T01:29:31.845ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
111812025-03-25T01:29:31.845ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
111822025-03-25T01:29:31.845ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111832025-03-25T01:29:31.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111842025-03-25T01:29:31.846ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
111852025-03-25T01:29:31.846ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
111862025-03-25T01:29:31.847ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111872025-03-25T01:29:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
111882025-03-25T01:29:31.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111892025-03-25T01:29:31.852ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111902025-03-25T01:29:31.853ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111912025-03-25T01:29:31.853ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
111922025-03-25T01:29:31.853ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 112.763304ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
111932025-03-25T01:29:31.856ZDEBGnexus (BackgroundTasks): activation complete background_task = read_only_region_replacement_start elapsed = 115.804367ms iteration = 21 status = {"errors":[],"requests_created_ok":[]}
111942025-03-25T01:29:31.859ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
111952025-03-25T01:29:31.860ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
111962025-03-25T01:29:31.864ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
111972025-03-25T01:29:31.864ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
111982025-03-25T01:29:31.864ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 124.639784ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
111992025-03-25T01:29:31.873ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112002025-03-25T01:29:31.873ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.529466ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112012025-03-25T01:29:31.880ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112022025-03-25T01:29:31.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112032025-03-25T01:29:31.885ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112042025-03-25T01:29:31.885ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112052025-03-25T01:29:31.892ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112062025-03-25T01:29:31.893ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112072025-03-25T01:29:31.899ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
112082025-03-25T01:29:31.899ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
112092025-03-25T01:29:31.899ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
112102025-03-25T01:29:31.899ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112112025-03-25T01:29:31.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112122025-03-25T01:29:31.901ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 161.887936ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112132025-03-25T01:29:31.922ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 62d85891-6bcf-47fd-99f3-6240c711b229 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
112142025-03-25T01:29:31.922ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112152025-03-25T01:29:31.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112162025-03-25T01:29:31.925ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
112172025-03-25T01:29:31.925ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112182025-03-25T01:29:31.925ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "34ffcaaa-40f6-4140-8550-7f1db2c921b8", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
112192025-03-25T01:29:31.925ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112202025-03-25T01:29:31.925ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
112212025-03-25T01:29:31.926ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
112222025-03-25T01:29:31.927ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
112232025-03-25T01:29:31.928ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112242025-03-25T01:29:31.940ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
112252025-03-25T01:29:32.029ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1085 zone_address = fd00:1122:3344:101::2
112262025-03-25T01:29:32.029ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112272025-03-25T01:29:32.029ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c70d043-e174-4656-9ca6-1017c5642c1c", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
112282025-03-25T01:29:32.029ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1088 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112292025-03-25T01:29:32.031ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112302025-03-25T01:29:32.065ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112312025-03-25T01:29:32.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
112322025-03-25T01:29:32.069ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 329.027238ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112332025-03-25T01:29:32.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112342025-03-25T01:29:32.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112352025-03-25T01:29:32.071ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112362025-03-25T01:29:32.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112372025-03-25T01:29:32.072ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112382025-03-25T01:29:32.072ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112392025-03-25T01:29:32.072ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
112402025-03-25T01:29:32.072ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112412025-03-25T01:29:32.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112422025-03-25T01:29:32.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112432025-03-25T01:29:32.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112442025-03-25T01:29:32.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112452025-03-25T01:29:32.085ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
112462025-03-25T01:29:32.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 345.448973ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
112472025-03-25T01:29:32.111ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1085 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd zone_address = fd00:1122:3344:101::2
112482025-03-25T01:29:32.111ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112492025-03-25T01:29:32.111ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1ac3a811-fde7-4518-a279-da2dfc86c429", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
112502025-03-25T01:29:32.111ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1088 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112512025-03-25T01:29:32.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
112522025-03-25T01:29:32.131ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112532025-03-25T01:29:32.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112542025-03-25T01:29:32.139ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
112552025-03-25T01:29:32.140ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "832871e6-08ce-4e88-8f39-861959759fd3", "content-length": "1", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
112562025-03-25T01:29:32.142ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
112572025-03-25T01:29:32.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
112582025-03-25T01:29:32.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
112592025-03-25T01:29:32.155ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
112602025-03-25T01:29:32.155ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
112612025-03-25T01:29:32.156ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b19a622a-ef4f-456b-af94-050d3e8e5572", "content-length": "372", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
112622025-03-25T01:29:32.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112632025-03-25T01:29:32.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112642025-03-25T01:29:32.158ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112652025-03-25T01:29:32.159ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112662025-03-25T01:29:32.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112672025-03-25T01:29:32.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112682025-03-25T01:29:32.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112692025-03-25T01:29:32.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Fleet result = Ok(())
112702025-03-25T01:29:32.162ZDEBGnexus (BackgroundTasks): roles background_task = support_bundle_collector roles = RoleSet { roles: {} }
112712025-03-25T01:29:32.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = support_bundle_collector resource = Database result = Ok(())
112722025-03-25T01:29:32.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
112732025-03-25T01:29:32.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
112742025-03-25T01:29:32.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
112752025-03-25T01:29:32.164ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(1469a400-b88f-4d91-b4c3-6a7cd205b8d2, 0), (87d806d7-6486-48c2-9a46-fc8cd66e95f9, 0), (76fd242d-7bdf-4b4b-9ecd-c3e067117286, 0)]
112762025-03-25T01:29:32.165ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-1768bc4c-c9ec-4fc7-a560-5ef338d49e99.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1475, tv_nsec: 876074423 } })
112772025-03-25T01:29:32.166ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112782025-03-25T01:29:32.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112792025-03-25T01:29:32.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112802025-03-25T01:29:32.166ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112812025-03-25T01:29:32.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112822025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112832025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112842025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
112852025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
112862025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112872025-03-25T01:29:32.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
112882025-03-25T01:29:32.181ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 441.285804ms iteration = 21 status = null
112892025-03-25T01:29:32.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112902025-03-25T01:29:32.182ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 1e54f7e5-0241-40be-bb43-5fe289855c17 dns_zone_name = control-plane.oxide.internal found_so_far = 52 version = 1
112912025-03-25T01:29:32.182ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
112922025-03-25T01:29:32.182ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2025-03-25 01:20:06.503139 UTC dns_group = internal generation = 1
112932025-03-25T01:29:32.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 442.720705ms iteration = 11 status = {"generation":1}
112942025-03-25T01:29:32.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112952025-03-25T01:29:32.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112962025-03-25T01:29:32.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112972025-03-25T01:29:32.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112982025-03-25T01:29:32.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
112992025-03-25T01:29:32.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113002025-03-25T01:29:32.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113012025-03-25T01:29:32.190ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
113022025-03-25T01:29:32.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
113032025-03-25T01:29:32.192ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 452.400884ms iteration = 21 status = 0
113042025-03-25T01:29:32.204ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113052025-03-25T01:29:32.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Fleet result = Ok(())
113062025-03-25T01:29:32.207ZDEBGnexus (BackgroundTasks): roles background_task = tuf_artifact_replication roles = RoleSet { roles: {} }
113072025-03-25T01:29:32.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = tuf_artifact_replication resource = Database result = Ok(())
113082025-03-25T01:29:32.223ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/artifacts-config
113092025-03-25T01:29:32.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 483.693551ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[],"step_set_volume_deleted_ok":[]}
113102025-03-25T01:29:32.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts-config", status: 204, headers: {"x-request-id": "eaaf393f-dea4-43c4-9c0b-7d70cd9c2c95", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
113112025-03-25T01:29:32.224ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/artifacts
113122025-03-25T01:29:32.224ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = tuf_artifact_replication result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/artifacts", status: 200, headers: {"content-type": "application/json", "x-request-id": "c224079f-7be9-4796-8e4d-1802e36d6484", "content-length": "26", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
113132025-03-25T01:29:32.224ZINFOnexus (BackgroundTasks): Successfully got artifact list background_task = tuf_artifact_replication file = nexus/src/app/background/tasks/tuf_artifact_replication.rs:673 sled = http://[fd00:1122:3344:101::1]:12345
113142025-03-25T01:29:32.227ZDEBGnexus (BackgroundTasks): activation complete background_task = tuf_artifact_replication elapsed = 487.038779ms iteration = 3 status = {"generation":1,"last_run_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":1,"put_config_err":0,"put_config_ok":1,"put_err":0,"put_ok":0},"lifetime_counters":{"copy_err":0,"copy_ok":0,"list_err":0,"list_ok":2,"put_config_err":0,"put_config_ok":2,"put_err":0,"put_ok":0},"local_repos":0,"request_debug_ringbuf":[{"generation":1,"operation":"put_config","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:24:32.351556217Z"},{"operation":"list","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:24:32.354821944Z"},{"generation":1,"operation":"put_config","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:29:32.224267294Z"},{"operation":"list","target_sled":"1768bc4c-c9ec-4fc7-a560-5ef338d49e99","time":"2025-03-25T01:29:32.224655549Z"}]}
113152025-03-25T01:29:32.231ZINFOnexus (BackgroundTasks): No bundles to collect background_task = support_bundle_collector file = nexus/src/app/background/tasks/support_bundle_collector.rs:360
113162025-03-25T01:29:32.231ZDEBGnexus (BackgroundTasks): activation complete background_task = support_bundle_collector elapsed = 491.807388ms iteration = 21 status = {"cleanup_err":null,"cleanup_report":{"db_destroying_bundles_removed":0,"db_failing_bundles_updated":0,"sled_bundles_delete_failed":0,"sled_bundles_deleted_not_found":0,"sled_bundles_deleted_ok":0},"collection_err":null,"collection_report":null}
113172025-03-25T01:29:32.232ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113182025-03-25T01:29:32.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113192025-03-25T01:29:32.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113202025-03-25T01:29:32.236ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113212025-03-25T01:29:32.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
113222025-03-25T01:29:32.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
113232025-03-25T01:29:32.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
113242025-03-25T01:29:32.239ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113252025-03-25T01:29:32.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113262025-03-25T01:29:32.241ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113272025-03-25T01:29:32.241ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113282025-03-25T01:29:32.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113292025-03-25T01:29:32.243ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113302025-03-25T01:29:32.243ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113312025-03-25T01:29:32.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113322025-03-25T01:29:32.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113332025-03-25T01:29:32.245ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113342025-03-25T01:29:32.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113352025-03-25T01:29:32.245ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113362025-03-25T01:29:32.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113372025-03-25T01:29:32.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
113382025-03-25T01:29:32.248ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113392025-03-25T01:29:32.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113402025-03-25T01:29:32.250ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113412025-03-25T01:29:32.251ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113422025-03-25T01:29:32.251ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113432025-03-25T01:29:32.251ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 510.629857ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113442025-03-25T01:29:32.251ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
113452025-03-25T01:29:32.252ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
113462025-03-25T01:29:32.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
113472025-03-25T01:29:32.253ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113482025-03-25T01:29:32.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113492025-03-25T01:29:32.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113502025-03-25T01:29:32.255ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
113512025-03-25T01:29:32.255ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
113522025-03-25T01:29:32.255ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
113532025-03-25T01:29:32.255ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 515.474396ms iteration = 5 status = {"blueprint_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","inventory_collection_id":"76fd242d-7bdf-4b4b-9ecd-c3e067117286","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
113542025-03-25T01:29:32.255ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e35ed1c4-4f28-4293-8542-6f45a714adfe", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
113552025-03-25T01:29:32.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113562025-03-25T01:29:32.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113572025-03-25T01:29:32.256ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113582025-03-25T01:29:32.256ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 0 version = 2
113592025-03-25T01:29:32.256ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113602025-03-25T01:29:32.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113612025-03-25T01:29:32.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113622025-03-25T01:29:32.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113632025-03-25T01:29:32.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113642025-03-25T01:29:32.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113652025-03-25T01:29:32.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113662025-03-25T01:29:32.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113672025-03-25T01:29:32.259ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2025-03-25T01:19:30.034299Z, time_modified: 2025-03-25T01:19:30.034299Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, db_silo: Silo { identity: SiloIdentity { id: 9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2025-03-25T01:20:07.062083Z, time_modified: 2025-03-25T01:20:07.062083Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175" }] }) }
113682025-03-25T01:29:32.259ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 519.164519ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]}},"default_endpoint":{"silo_id":"9a81b8ef-a36f-4a8b-b795-0c9d1428d3c7","tls_certs":["e09544000d777870bebf1c9c16600f284e556613366f71437328220a360af175"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
113692025-03-25T01:29:32.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113702025-03-25T01:29:32.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113712025-03-25T01:29:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113722025-03-25T01:29:32.262ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113732025-03-25T01:29:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113742025-03-25T01:29:32.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113752025-03-25T01:29:32.264ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113762025-03-25T01:29:32.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113772025-03-25T01:29:32.265ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 60210834-8447-4faf-a5df-01a572eb2d5e dns_zone_name = oxide.test found_so_far = 1 version = 2
113782025-03-25T01:29:32.265ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
113792025-03-25T01:29:32.265ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2025-03-25 01:20:07.107344 UTC dns_group = external generation = 2
113802025-03-25T01:29:32.265ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 525.265385ms iteration = 11 status = {"generation":2}
113812025-03-25T01:29:32.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113822025-03-25T01:29:32.267ZINFOnexus (BackgroundTasks): VPC route manager sled 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
113832025-03-25T01:29:32.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113842025-03-25T01:29:32.267ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
113852025-03-25T01:29:32.267ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f722c9d9-6d66-488c-b34b-44d73c2e32ea", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
113862025-03-25T01:29:32.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113872025-03-25T01:29:32.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113882025-03-25T01:29:32.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113892025-03-25T01:29:32.269ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 529.245733ms iteration = 21 status = {}
113902025-03-25T01:29:32.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113912025-03-25T01:29:32.271ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113922025-03-25T01:29:32.272ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
113932025-03-25T01:29:32.273ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "93931eaf-26bf-4340-bd7e-e46187802881", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
113942025-03-25T01:29:32.273ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
113952025-03-25T01:29:32.274ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113962025-03-25T01:29:32.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113972025-03-25T01:29:32.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113982025-03-25T01:29:32.275ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b4508f89-84cd-4f10-a1a8-333e4a73224b", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
113992025-03-25T01:29:32.275ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
114002025-03-25T01:29:32.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114012025-03-25T01:29:32.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114022025-03-25T01:29:32.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114032025-03-25T01:29:32.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114042025-03-25T01:29:32.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114052025-03-25T01:29:32.277ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::8]:5353, [fd00:1122:3344:101::9]:5353] }
114062025-03-25T01:29:32.277ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 537.704224ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
114072025-03-25T01:29:32.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114082025-03-25T01:29:32.278ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114092025-03-25T01:29:32.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114102025-03-25T01:29:32.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114112025-03-25T01:29:32.281ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114122025-03-25T01:29:32.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114132025-03-25T01:29:32.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114142025-03-25T01:29:32.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114152025-03-25T01:29:32.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114162025-03-25T01:29:32.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114172025-03-25T01:29:32.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114182025-03-25T01:29:32.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114192025-03-25T01:29:32.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114202025-03-25T01:29:32.287ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114212025-03-25T01:29:32.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114222025-03-25T01:29:32.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114232025-03-25T01:29:32.289ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 549.466443ms iteration = 21 status = {}
114242025-03-25T01:29:32.293ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114252025-03-25T01:29:32.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114262025-03-25T01:29:32.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114272025-03-25T01:29:32.294ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114282025-03-25T01:29:32.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114292025-03-25T01:29:32.309ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
114302025-03-25T01:29:32.309ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 568.925161ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114312025-03-25T01:29:32.315ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
114322025-03-25T01:29:32.316ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3263edb8-76dc-4e8a-aff0-ab7956d7329a", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114332025-03-25T01:29:32.316ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114342025-03-25T01:29:32.318ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cfbe64da-63f4-4de5-82d7-14875c348aa6", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114352025-03-25T01:29:32.318ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114362025-03-25T01:29:32.319ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "2e931bab-0346-41b6-9f71-4d84aa29516f", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114372025-03-25T01:29:32.319ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114382025-03-25T01:29:32.321ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
114392025-03-25T01:29:32.321ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 581.424499ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
114402025-03-25T01:29:32.326ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 586.897588ms iteration = 23 status = {"physical_disks_added":0}
114412025-03-25T01:29:32.391ZDEBGnexus (BackgroundTasks): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
114422025-03-25T01:29:32.392ZDEBGnexus (BackgroundTasks): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "6be1da69-2211-492b-981d-84c74e63278b", "content-length": "691", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
114432025-03-25T01:29:32.392ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
114442025-03-25T01:29:32.392ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
114452025-03-25T01:29:32.392ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
114462025-03-25T01:29:32.393ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 653.038224ms iteration = 21 status = {}
114472025-03-25T01:29:32.393ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114482025-03-25T01:29:32.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114492025-03-25T01:29:32.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114502025-03-25T01:29:32.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114512025-03-25T01:29:32.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114522025-03-25T01:29:32.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114532025-03-25T01:29:32.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114542025-03-25T01:29:32.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114552025-03-25T01:29:32.405ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114562025-03-25T01:29:32.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114572025-03-25T01:29:32.408ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114582025-03-25T01:29:32.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114592025-03-25T01:29:32.410ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114602025-03-25T01:29:32.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114612025-03-25T01:29:32.413ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114622025-03-25T01:29:32.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114632025-03-25T01:29:32.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114642025-03-25T01:29:32.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114652025-03-25T01:29:32.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114662025-03-25T01:29:32.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114672025-03-25T01:29:32.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114682025-03-25T01:29:32.420ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114692025-03-25T01:29:32.420ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114702025-03-25T01:29:32.420ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114712025-03-25T01:29:32.420ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "adca30f9-0c8f-4d10-8e21-fe252f963ba7", "content-length": "476", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114722025-03-25T01:29:32.420ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114732025-03-25T01:29:32.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
114742025-03-25T01:29:32.423ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114752025-03-25T01:29:32.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114762025-03-25T01:29:32.424ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "cd2b3656-4363-4d1e-b624-3fcb3a5b7aff", "content-length": "734", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114772025-03-25T01:29:32.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114782025-03-25T01:29:32.424ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e89e96-bab8-4705-beec-3f3827a82a05", "content-length": "111", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114792025-03-25T01:29:32.424ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114802025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7465d8cd-229c-4efd-8280-b45b6eb18750", "content-length": "111", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114812025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114822025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b86c8c50-bc67-484e-aca7-4511fd9ed80a", "content-length": "167", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114832025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114842025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ea56c93-a3c2-468e-85a2-402a40c25705", "content-length": "167", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114852025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114862025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "14d622ce-77fe-439a-9013-405248967c21", "content-length": "175", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114872025-03-25T01:29:32.425ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114882025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8552e16-57b0-4f45-a07b-775ef887223d", "content-length": "175", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114892025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114902025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "75921eab-ffe5-4976-a3d7-c89581eeaa66", "content-length": "702", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114912025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114922025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "07ae7a71-fe2e-46a6-99dd-36c77935cd18", "content-length": "727", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114932025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114942025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "02394054-b0a7-4bef-ab03-6d352cce76f3", "content-length": "729", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114952025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114962025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "cec07b5c-799b-4729-9f00-2798126d7ef1", "content-length": "728", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114972025-03-25T01:29:32.426ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
114982025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7139b6f-1d8f-49b4-b18a-07c67563e955", "content-length": "722", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
114992025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
115002025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e25856-d328-41ea-9e6c-1d777c940969", "content-length": "109", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115012025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
115022025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e21baa61-f167-4a6e-87ec-8c394c527787", "content-length": "109", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115032025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
115042025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115052025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2959462e-5a40-4a9c-840f-39b1d393fabc", "content-length": "169", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115062025-03-25T01:29:32.427ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
115072025-03-25T01:29:32.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115082025-03-25T01:29:32.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f72874e0-2637-4bdd-8054-ebbb0bdeb631", "content-length": "169", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115092025-03-25T01:29:32.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
115102025-03-25T01:29:32.428ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4e981e6-1bc9-415f-b2c5-4806b029b227", "content-length": "178", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115112025-03-25T01:29:32.428ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
115122025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cb722baf-e084-409c-886f-142a6f9b7028", "content-length": "178", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115132025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
115142025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d26f95f-a676-40c5-880a-c198d3a5f0f5", "content-length": "702", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115152025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115162025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "7550f2d5-b253-49b7-8ac2-cbb3a8142456", "content-length": "727", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115172025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115182025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae1abe08-7817-49b4-8ce0-45ebd58c120f", "content-length": "729", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115192025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115202025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4db8961-dd6e-49e2-9bc5-ebb6d223c6f1", "content-length": "728", "date": "Tue, 25 Mar 2025 01:29:31 GMT"} })
115212025-03-25T01:29:32.429ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115222025-03-25T01:29:32.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115232025-03-25T01:29:32.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115242025-03-25T01:29:32.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115252025-03-25T01:29:32.431ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115262025-03-25T01:29:32.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115272025-03-25T01:29:32.433ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115282025-03-25T01:29:32.433ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115292025-03-25T01:29:32.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115302025-03-25T01:29:32.435ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115312025-03-25T01:29:32.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115322025-03-25T01:29:32.437ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115332025-03-25T01:29:32.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115342025-03-25T01:29:32.438ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
115352025-03-25T01:29:32.438ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115362025-03-25T01:29:32.438ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115372025-03-25T01:29:32.444ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
115382025-03-25T01:29:32.444ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115392025-03-25T01:29:32.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115402025-03-25T01:29:32.446ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115412025-03-25T01:29:32.447ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
115422025-03-25T01:29:32.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115432025-03-25T01:29:32.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115442025-03-25T01:29:32.449ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
115452025-03-25T01:29:32.449ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 0e05f88a-ce90-445e-96ff-49db3833e8b9, kind: Service { id: 658f8989-b24e-48cb-83e6-b3a3b15d47d4 }, name: Name("external-dns-658f8989-b24e-48cb-83e6-b3a3b15d47d4"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 226, 64])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: bf36a918-76bf-45b7-9149-0156ee74d532, kind: Service { id: 4b6e96f6-cd23-4897-9bfb-96b629ccf872 }, name: Name("external-dns-4b6e96f6-cd23-4897-9bfb-96b629ccf872"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 191, 12])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1bff16e6-5fab-416c-8beb-b91d2ad5977c, kind: Service { id: 18f2afbd-55f1-471d-92cc-2f4294ad7bfd }, name: Name("nexus-18f2afbd-55f1-471d-92cc-2f4294ad7bfd"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 244, 142])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5ddeed0a-a1ee-4f9b-a849-c0c7c08797df, kind: Service { id: 3382b509-413c-4e85-971f-4b24ca64ae0c }, name: Name("nexus-3382b509-413c-4e85-971f-4b24ca64ae0c"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 249, 122])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 7d98feaa-21f9-4a6a-af38-fccb93755353, kind: Service { id: 35dfc82d-051d-4e93-9771-05f76e04a80f }, name: Name("nexus-35dfc82d-051d-4e93-9771-05f76e04a80f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 154, 223])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
115462025-03-25T01:29:32.449ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
115472025-03-25T01:29:32.539ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115482025-03-25T01:29:32.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115492025-03-25T01:29:32.549ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
115502025-03-25T01:29:32.549ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
115512025-03-25T01:29:32.552ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:150 port = SwitchPort { id: 1a5160a0-1d63-486b-827e-4b7de2ad2079, rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(80c078c2-e0e7-4e11-a9de-db9b8488eb2c) } rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
115522025-03-25T01:29:32.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115532025-03-25T01:29:32.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115542025-03-25T01:29:32.562ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
115552025-03-25T01:29:32.563ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5dfa5b3d-6041-4ad9-a307-ee20dd2c75e3", "content-length": "134", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
115562025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1741 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
115572025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1768 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 80c078c2-e0e7-4e11-a9de-db9b8488eb2c
115582025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:378 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
115592025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:382 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
115602025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:391 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115612025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:397 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115622025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115632025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1915 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115642025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:408 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
115652025-03-25T01:29:32.563ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1951 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
115662025-03-25T01:29:32.564ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:417 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd
115672025-03-25T01:29:32.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115682025-03-25T01:29:32.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115692025-03-25T01:29:32.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115702025-03-25T01:29:32.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b371ed8a-3bf3-44c3-b14b-8366a3e07130", "content-length": "2", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
115712025-03-25T01:29:32.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115722025-03-25T01:29:32.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff908826-92a0-4a1b-a988-80123171eb68", "content-length": "51", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
115732025-03-25T01:29:32.567ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:466 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch_location = Switch0
115742025-03-25T01:29:32.567ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115752025-03-25T01:29:32.682ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, time_created: 2025-03-25T01:20:03.714241Z, time_modified: 2025-03-25T01:20:03.714241Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 16a011db-af85-49cc-8fa6-b468f46a78bd, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)), repo_depot_port: SqlU16(12348) }]
115762025-03-25T01:29:32.683ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
115772025-03-25T01:29:32.683ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115782025-03-25T01:29:32.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115792025-03-25T01:29:32.685ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fdd392b-6c01-4932-8d21-9fd0bd12beb3 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
115802025-03-25T01:29:32.685ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115812025-03-25T01:29:32.685ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fdd392b-6c01-4932-8d21-9fd0bd12beb3 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
115822025-03-25T01:29:32.685ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115832025-03-25T01:29:32.687ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115842025-03-25T01:29:32.687ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2553 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2fdd392b-6c01-4932-8d21-9fd0bd12beb3 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
115852025-03-25T01:29:32.694ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 1768bc4c-c9ec-4fc7-a560-5ef338d49e99, lookup_type: ById(1768bc4c-c9ec-4fc7-a560-5ef338d49e99) } result = Ok(())
115862025-03-25T01:29:32.710ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "834530ba-2a52-46f0-8141-f89b78127f0a", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
115872025-03-25T01:29:32.710ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:769 rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd switch = Switch0
115882025-03-25T01:29:32.710ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115892025-03-25T01:29:32.711ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 16a011db-af85-49cc-8fa6-b468f46a78bd result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b600fc3-0341-4ba2-aca9-f0ce9379e7fe", "content-length": "682", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
115902025-03-25T01:29:32.711ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115912025-03-25T01:29:32.711ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115922025-03-25T01:29:32.715ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115932025-03-25T01:29:32.715ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115942025-03-25T01:29:32.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115952025-03-25T01:29:32.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115962025-03-25T01:29:32.726ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115972025-03-25T01:29:32.727ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115982025-03-25T01:29:32.731ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
115992025-03-25T01:29:32.733ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 1768bc4c-c9ec-4fc7-a560-5ef338d49e99 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "cae362a7-f653-4294-a9bc-243c128a9a3e", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
116002025-03-25T01:29:32.734ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 994.856345ms iteration = 21 status = {}
116012025-03-25T01:29:32.735ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
116022025-03-25T01:29:32.735ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 995.203031ms
116032025-03-25T01:29:32.735ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 995.212361ms iteration = 3 status = {}
116042025-03-25T01:29:33.015ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "caa7d56d-26e2-4d14-b9c4-d9eb48b85e8c", "content-length": "31974", "date": "Tue, 25 Mar 2025 01:29:32 GMT"} })
116052025-03-25T01:29:33.017ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116062025-03-25T01:29:33.017ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116072025-03-25T01:29:33.017ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
116082025-03-25T01:29:33.019ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116092025-03-25T01:29:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116102025-03-25T01:29:33.021ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116112025-03-25T01:29:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
116122025-03-25T01:29:33.023ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116132025-03-25T01:29:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116142025-03-25T01:29:33.197ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = d52c3b4d-5151-4ca5-8be0-51bddd1bccb8 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
116152025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = d52c3b4d-5151-4ca5-8be0-51bddd1bccb8 time_started = 2025-03-25 01:29:32.420096 UTC
116162025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_rendezvous iteration = 6 reason = Dependency
116172025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.457235452s iteration = 3 status = {"collection_id":"d52c3b4d-5151-4ca5-8be0-51bddd1bccb8","time_done":"2025-03-25 01:29:33.017383 UTC","time_started":"2025-03-25 01:29:32.420096 UTC"}
116182025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
116192025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116202025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116212025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116222025-03-25T01:29:33.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116232025-03-25T01:29:33.199ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116242025-03-25T01:29:33.200ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116252025-03-25T01:29:33.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116262025-03-25T01:29:33.200ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116272025-03-25T01:29:33.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116282025-03-25T01:29:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Inventory result = Ok(())
116292025-03-25T01:29:33.202ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116302025-03-25T01:29:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116312025-03-25T01:29:33.203ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116322025-03-25T01:29:33.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116332025-03-25T01:29:33.205ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116342025-03-25T01:29:33.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116352025-03-25T01:29:33.206ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116362025-03-25T01:29:33.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116372025-03-25T01:29:33.213ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116382025-03-25T01:29:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116392025-03-25T01:29:33.270ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116402025-03-25T01:29:33.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116412025-03-25T01:29:33.272ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116422025-03-25T01:29:33.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
116432025-03-25T01:29:33.274ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116442025-03-25T01:29:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116452025-03-25T01:29:33.276ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116462025-03-25T01:29:33.277ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
116472025-03-25T01:29:33.277ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116482025-03-25T01:29:33.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116492025-03-25T01:29:33.279ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116502025-03-25T01:29:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116512025-03-25T01:29:33.280ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116522025-03-25T01:29:33.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
116532025-03-25T01:29:33.282ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116542025-03-25T01:29:33.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116552025-03-25T01:29:33.283ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116562025-03-25T01:29:33.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Fleet result = Ok(())
116572025-03-25T01:29:33.285ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_rendezvous roles = RoleSet { roles: {} }
116582025-03-25T01:29:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_rendezvous resource = Database result = Ok(())
116592025-03-25T01:29:33.287ZINFOnexus (BackgroundTasks): ensured all Crucible datasets present in inventory have database records background_task = blueprint_rendezvous file = nexus/reconfigurator/rendezvous/src/crucible_dataset.rs:113 num_already_exist = 9 num_inserted = 0 num_not_in_inventory = 0
116602025-03-25T01:29:33.287ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_rendezvous elapsed = 90.642826ms iteration = 6 status = {"blueprint_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","inventory_collection_id":"d52c3b4d-5151-4ca5-8be0-51bddd1bccb8","stats":{"crucible_dataset":{"num_already_exist":9,"num_inserted":0,"num_not_in_inventory":0},"debug_dataset":{"num_already_exist":9,"num_already_tombstoned":0,"num_inserted":0,"num_not_in_inventory":0,"num_tombstoned":0}}}
116612025-03-25T01:29:33.316ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 118.930991ms iteration = 24 status = {"physical_disks_added":0}
116622025-03-25T01:29:33.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec748bcd-f221-42ef-989c-9465d8bfff19 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116632025-03-25T01:29:33.716ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec748bcd-f221-42ef-989c-9465d8bfff19 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116642025-03-25T01:29:33.718ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2573 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ec748bcd-f221-42ef-989c-9465d8bfff19 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116652025-03-25T01:29:34.740ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ff9e0db2-2bda-4f69-8cd2-d2d77ec4f74f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116662025-03-25T01:29:34.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ff9e0db2-2bda-4f69-8cd2-d2d77ec4f74f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116672025-03-25T01:29:34.742ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2444 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ff9e0db2-2bda-4f69-8cd2-d2d77ec4f74f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116682025-03-25T01:29:35.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 248f6804-3c5a-4484-b8f4-4136357d2b61 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116692025-03-25T01:29:35.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 248f6804-3c5a-4484-b8f4-4136357d2b61 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116702025-03-25T01:29:35.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2292 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 248f6804-3c5a-4484-b8f4-4136357d2b61 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116712025-03-25T01:29:35.766ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 448 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = ac499ced-622b-44d7-ba6b-c4f09ef399d7 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
116722025-03-25T01:29:36.785ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d32b8f02-0cf0-4b43-ac99-e00d95ff9fab roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116732025-03-25T01:29:36.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d32b8f02-0cf0-4b43-ac99-e00d95ff9fab resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116742025-03-25T01:29:36.787ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2878 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d32b8f02-0cf0-4b43-ac99-e00d95ff9fab response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116752025-03-25T01:29:37.808ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36dd26d4-cf3f-44c3-8d9d-30c1ec299e4b roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116762025-03-25T01:29:37.808ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36dd26d4-cf3f-44c3-8d9d-30c1ec299e4b resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116772025-03-25T01:29:37.810ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1960 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 36dd26d4-cf3f-44c3-8d9d-30c1ec299e4b response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116782025-03-25T01:29:38.830ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660222e2-6c92-4819-8a1c-8c1ed20edef5 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116792025-03-25T01:29:38.831ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660222e2-6c92-4819-8a1c-8c1ed20edef5 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116802025-03-25T01:29:38.832ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2175 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 660222e2-6c92-4819-8a1c-8c1ed20edef5 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116812025-03-25T01:29:39.853ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 123eac59-a245-4ae0-9231-7489d76b4729 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116822025-03-25T01:29:39.853ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 123eac59-a245-4ae0-9231-7489d76b4729 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116832025-03-25T01:29:39.855ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2253 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 123eac59-a245-4ae0-9231-7489d76b4729 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116842025-03-25T01:29:40.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48aa757d-82fa-4812-b306-93edd238cd14 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116852025-03-25T01:29:40.876ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48aa757d-82fa-4812-b306-93edd238cd14 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116862025-03-25T01:29:40.877ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 48aa757d-82fa-4812-b306-93edd238cd14 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
116872025-03-25T01:29:41.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116882025-03-25T01:29:41.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116892025-03-25T01:29:41.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116902025-03-25T01:29:41.740ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
116912025-03-25T01:29:41.740ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116922025-03-25T01:29:41.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116932025-03-25T01:29:41.742ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116942025-03-25T01:29:41.742ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116952025-03-25T01:29:41.743ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116962025-03-25T01:29:41.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116972025-03-25T01:29:41.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116982025-03-25T01:29:41.744ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.981287ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116992025-03-25T01:29:41.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117002025-03-25T01:29:41.749ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117012025-03-25T01:29:41.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117022025-03-25T01:29:41.752ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117032025-03-25T01:29:41.756ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
117042025-03-25T01:29:41.756ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117052025-03-25T01:29:41.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117062025-03-25T01:29:41.765ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
117072025-03-25T01:29:41.766ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 26.221916ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
117082025-03-25T01:29:41.897ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2dcbc66-061f-4351-9dd9-f15181d0493a roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117092025-03-25T01:29:41.898ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2dcbc66-061f-4351-9dd9-f15181d0493a resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117102025-03-25T01:29:41.899ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2060 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = e2dcbc66-061f-4351-9dd9-f15181d0493a response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117112025-03-25T01:29:42.920ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea1d078b-ee11-465b-b0df-ef3bd4bf66ee roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117122025-03-25T01:29:42.921ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea1d078b-ee11-465b-b0df-ef3bd4bf66ee resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117132025-03-25T01:29:42.923ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2384 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = ea1d078b-ee11-465b-b0df-ef3bd4bf66ee response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117142025-03-25T01:29:43.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fa19d592-81c0-4c54-add0-ce26ae5ccf36 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117152025-03-25T01:29:43.943ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fa19d592-81c0-4c54-add0-ce26ae5ccf36 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117162025-03-25T01:29:43.945ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2523 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fa19d592-81c0-4c54-add0-ce26ae5ccf36 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117172025-03-25T01:29:44.965ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7b87ff0-7649-438b-9074-9dd0205ac5c8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117182025-03-25T01:29:44.965ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7b87ff0-7649-438b-9074-9dd0205ac5c8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117192025-03-25T01:29:44.967ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1978 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = f7b87ff0-7649-438b-9074-9dd0205ac5c8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117202025-03-25T01:29:45.759ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:1025 local_addr = [fd00:1122:3344:101::b]:12221 remote_addr = [fd00:1122:3344:101::d]:62439
117212025-03-25T01:29:45.759ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 4f108aa6-a564-4598-a86a-f0a5f0b5468b roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
117222025-03-25T01:29:45.759ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 4f108aa6-a564-4598-a86a-f0a5f0b5468b resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
117232025-03-25T01:29:45.761ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2358 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 4f108aa6-a564-4598-a86a-f0a5f0b5468b response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?sort_by=id_ascending
117242025-03-25T01:29:45.761ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 615a3de3-f1f5-424c-8896-1dd87bade2c7 roles = RoleSet { roles: {} } uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
117252025-03-25T01:29:45.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 615a3de3-f1f5-424c-8896-1dd87bade2c7 resource = Database result = Ok(()) uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
117262025-03-25T01:29:45.764ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2417 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:62439 req_id = 615a3de3-f1f5-424c-8896-1dd87bade2c7 response_code = 200 uri = /metrics/collectors/a9f260fd-b911-4f87-b07b-84934591a3eb/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiI4MzI5NzcxOC01ZjQyLTQ3NmMtYTA2Ni1iODU2ZmRlODVmMjUifX0%3D
117272025-03-25T01:29:45.767ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 470 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 268b095f-591d-470d-ab1d-de1590d0c393 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
117282025-03-25T01:29:45.987ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 492d8839-d771-4e69-9a25-466b5bdae9ff roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117292025-03-25T01:29:45.987ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 492d8839-d771-4e69-9a25-466b5bdae9ff resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117302025-03-25T01:29:45.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1740 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 492d8839-d771-4e69-9a25-466b5bdae9ff response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117312025-03-25T01:29:47.010ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc0c1464-2621-4a79-b5c6-7d8dac026107 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117322025-03-25T01:29:47.010ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc0c1464-2621-4a79-b5c6-7d8dac026107 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117332025-03-25T01:29:47.013ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2650 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fc0c1464-2621-4a79-b5c6-7d8dac026107 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117342025-03-25T01:29:48.033ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d62fb314-4efb-4c83-a972-a69a45173254 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117352025-03-25T01:29:48.034ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d62fb314-4efb-4c83-a972-a69a45173254 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117362025-03-25T01:29:48.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2125 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = d62fb314-4efb-4c83-a972-a69a45173254 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117372025-03-25T01:29:49.058ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bf991f0-ae22-4bc1-9287-7ae372281ff8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117382025-03-25T01:29:49.058ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bf991f0-ae22-4bc1-9287-7ae372281ff8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117392025-03-25T01:29:49.060ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2156 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bf991f0-ae22-4bc1-9287-7ae372281ff8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117402025-03-25T01:29:50.081ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = aec4e94f-684d-44ec-b0ff-708481958f43 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117412025-03-25T01:29:50.081ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = aec4e94f-684d-44ec-b0ff-708481958f43 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117422025-03-25T01:29:50.083ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2159 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = aec4e94f-684d-44ec-b0ff-708481958f43 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117432025-03-25T01:29:51.105ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 74299412-854a-4262-a085-4aa98996b092 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117442025-03-25T01:29:51.105ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 74299412-854a-4262-a085-4aa98996b092 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117452025-03-25T01:29:51.107ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2062 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 74299412-854a-4262-a085-4aa98996b092 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117462025-03-25T01:29:51.739ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
117472025-03-25T01:29:51.739ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117482025-03-25T01:29:51.740ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117492025-03-25T01:29:51.741ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
117502025-03-25T01:29:51.741ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117512025-03-25T01:29:51.741ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117522025-03-25T01:29:51.741ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117532025-03-25T01:29:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117542025-03-25T01:29:51.744ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117552025-03-25T01:29:51.744ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117562025-03-25T01:29:51.746ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117572025-03-25T01:29:51.746ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117582025-03-25T01:29:51.747ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117592025-03-25T01:29:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 3ed5031c-b711-4951-ae01-aa99dea7c00b, lookup_type: ById(3ed5031c-b711-4951-ae01-aa99dea7c00b) } result = Ok(())
117602025-03-25T01:29:51.750ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117612025-03-25T01:29:51.750ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117622025-03-25T01:29:51.759ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b original_time_created = 2025-03-25 01:19:22.301325 UTC target_id = 3ed5031c-b711-4951-ae01-aa99dea7c00b time_created = 2025-03-25 01:19:22.301325 UTC
117632025-03-25T01:29:51.759ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.56018ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"3ed5031c-b711-4951-ae01-aa99dea7c00b","time_created":"2025-03-25T01:19:22.301325Z"}
117642025-03-25T01:29:51.771ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117652025-03-25T01:29:51.772ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117662025-03-25T01:29:51.773ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.279982ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117672025-03-25T01:29:52.129ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 82f4cc2d-0857-42a2-a6ac-2052b5da19cd roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117682025-03-25T01:29:52.129ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 82f4cc2d-0857-42a2-a6ac-2052b5da19cd resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117692025-03-25T01:29:52.130ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1884 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 82f4cc2d-0857-42a2-a6ac-2052b5da19cd response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117702025-03-25T01:29:53.152ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bac8d5e-5663-42ed-8024-7f64ad232142 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117712025-03-25T01:29:53.152ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bac8d5e-5663-42ed-8024-7f64ad232142 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117722025-03-25T01:29:53.154ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2066 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5bac8d5e-5663-42ed-8024-7f64ad232142 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117732025-03-25T01:29:54.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54541089-abbd-4d6e-bf6b-cde757f4648f roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117742025-03-25T01:29:54.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54541089-abbd-4d6e-bf6b-cde757f4648f resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117752025-03-25T01:29:54.177ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2013 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 54541089-abbd-4d6e-bf6b-cde757f4648f response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117762025-03-25T01:29:55.198ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 39fdf304-1253-4d3b-a9cb-ecd72c21ffde roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117772025-03-25T01:29:55.198ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 39fdf304-1253-4d3b-a9cb-ecd72c21ffde resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117782025-03-25T01:29:55.200ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2695 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 39fdf304-1253-4d3b-a9cb-ecd72c21ffde response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117792025-03-25T01:29:55.766ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 497 local_addr = [fd00:1122:3344:101::b]:37373 method = GET remote_addr = [fd00:1122:3344:101::d]:48741 req_id = 9fe97297-e2cc-400c-bde8-249ce4db2320 response_code = 200 uri = /3382b509-413c-4e85-971f-4b24ca64ae0c
117802025-03-25T01:29:56.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ffb5cac-82fc-4688-939d-abdaa5705272 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117812025-03-25T01:29:56.221ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ffb5cac-82fc-4688-939d-abdaa5705272 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117822025-03-25T01:29:56.222ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2118 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 2ffb5cac-82fc-4688-939d-abdaa5705272 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117832025-03-25T01:29:57.243ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb6f1a15-125e-4c8a-957b-a2c827b53d35 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117842025-03-25T01:29:57.244ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb6f1a15-125e-4c8a-957b-a2c827b53d35 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117852025-03-25T01:29:57.245ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2047 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = fb6f1a15-125e-4c8a-957b-a2c827b53d35 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117862025-03-25T01:29:58.266ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 601fd4f3-7fbe-4616-aaab-123a232ddfdb roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117872025-03-25T01:29:58.266ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 601fd4f3-7fbe-4616-aaab-123a232ddfdb resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117882025-03-25T01:29:58.268ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2330 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 601fd4f3-7fbe-4616-aaab-123a232ddfdb response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117892025-03-25T01:29:59.288ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ef674b5-d5aa-40e7-aba4-0b8ea97b94b8 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117902025-03-25T01:29:59.289ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ef674b5-d5aa-40e7-aba4-0b8ea97b94b8 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117912025-03-25T01:29:59.290ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 1968 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 5ef674b5-d5aa-40e7-aba4-0b8ea97b94b8 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117922025-03-25T01:30:00.310ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8520caae-557e-4f32-86c7-3e9de28c2bd1 roles = RoleSet { roles: {} } uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117932025-03-25T01:30:00.310ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8520caae-557e-4f32-86c7-3e9de28c2bd1 resource = Database result = Ok(()) uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99
117942025-03-25T01:30:00.312ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-1949cf8c6b5b557f/dropshot-0.16.0/src/server.rs:867 latency_us = 2227 local_addr = [fd00:1122:3344:101::b]:12221 method = GET remote_addr = [fd00:1122:3344:101::1]:36658 req_id = 8520caae-557e-4f32-86c7-3e9de28c2bd1 response_code = 200 uri = /probes/1768bc4c-c9ec-4fc7-a560-5ef338d49e99